Senior Software EngineerPython AWS

Position Description:

Skill:Sr. Full Stack Engineer Python Expertise (focused primarily on Data Engineering ELT/ETL):
Experience: 5 Years
Responsibilities & Qualifications
Strong hands-on experience in Python leveraging libraries such as PySpark Scikit-learn TensorFlow PyTorch Pandas PyArrow and related tools for large-scale data transformation processing and automation.
Design develop and optimize distributed data pipelines using Apache Spark (PySpark).
Deploy and manage Spark workloads on AWS EMR (including cluster sizing autoscaling performance tuning).
Experience implementing centralized data governance and analytics solutions on AWS including AWS Glue Data Catalog EMR Athena PySpark and Glue Jobs.
Develop ETL/ELT workflows using AWS Glue (Glue Jobs Crawlers Data Catalog).
Orchestrate data workflows using Step Functions / Airflow / Glue Workflows.
Strong understanding of business-layer modeling data pipelines data architecture and both real-time and batch data processing frameworks.
Hands-on experience with AWS cloud services including but not limited to:
oEC2 S3 CloudFront API Gateway Lambda
oRDS / PostgreSQL
oIAM roles and access policies
oKubernetes (EKS Helm)
Familiarity with DevOps tools such as Git GitLab CloudFormation and Terraform is an added advantage.
Experience building and managing containerized applications using open-source technologies and Kubernetes.
Experience supporting data processing and enrichment platforms including event streaming systems.
Experience developing component-based Single Page Applications (SPA) using Angular with TypeScript or comparable JavaScript frameworks.
Required Skills
Minimum 5 years of hands-on experience with PySpark and AWS Glue.
Experience managing and optimizing AWS EMR clusters.
Strong proficiency in SQL.
Practical experience with Scikit-learn TensorFlow or PyTorch.
Good to Have
Experience with Docker and containerization technologies.
Experience building Kafka-based streaming pipelines.

Skills:

• Analytical Thinking
• Kubernetes
• Python
• Terraform

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our teamone of the largest IT and business consulting services firms in the world.