Technology Lead AWS Data Engineer

Infosys is seeking an experienced Data Engineer with 6 years of experience in building scalable data platforms and ETL pipelines. The ideal candidate should have strong hands-on expertise in AWS Athena Scala and Apache Spark with experience designing and optimizing large-scale data processing solutions in AWS environments. Experience with AWS data lake architectures performance tuning and distributed data processing is essential. The requirements align with enterprise data engineering practices found in internal data engineering profiles and job descriptions.

Required Qualifications

• Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
• At least 4 years of Information Technology experience
• Candidate must be located within commuting distance ofBurnaby BCor be willing to relocate to one of these position may require travel.

• Design develop and maintain scalable ETL/ELT pipelines using Scala and Apache Spark.
• Build and optimize data processing workflows for large-scale structured and semi-structured datasets.
• Develop and manage data lake solutions using AWS S3 Athena Glue and EMR.
• Optimize Athena queries partitions and data storage formats to improve performance and reduce costs.
• Implement data quality checks validation frameworks and monitoring solutions.
• Integrate data from multiple sources including databases APIs streaming platforms and flat files.
• Collaborate with Data Architects Analysts and Business Stakeholders to deliver data solutions.
• Tune Spark jobs by optimizing joins partitioning caching and shuffle operations.
• Support CI/CD deployments release management and production issue resolution.
• Participate in Agile ceremonies code reviews and technical design discussions.
• At least 6years of experience in Data Engineering.
• Strong hands-on experience with AWS Athena.
• Strong development experience in Scala.
• Expertise in Apache Spark (Spark Core Spark SQL).
• Experience with AWS services such as S3 Glue EMR IAM CloudWatch.
• Strong SQL and data modeling skills.
• Experience building and maintaining ETL/ELT pipelines.
• Good understanding of distributed data processing and performance tuning.
• Experience with Git and CI/CD practices.

About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills expertise and ideas from our innovation ecosystem.

EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy childbirth or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.