Data Engineer - Lead
Data Engineer - Lead
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Position Description:
Company Profile:
At CGI were a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72000 professionals located in 40 countries. Founded in 1976 CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources expertise stability and dedicated professionals needed to achieve. At CGI were a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72000 professionals located in 40 countries. Founded in 1976 CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources expertise stability and dedicated professionals needed to achieve results for our clients - and for our members. Come grow with us. Learn more at .
This is a great opportunity to join a winning team. CGI offers a competitive compensation package with opportunities for growth and professional development. Benefits for full-time permanent members start on the first day of employment and include a paid time-off program and profit participation and stock purchase plans. We wish to thank all applicants for their interest and effort in applying for this position however only candidates selected for interviews will be contacted. No unsolicited agency referrals please.
Job Title: Senior Software Engineer Data Engineer Lead
Position: Senior Software Engineer
Position ID: J0825-1197
Experience: 12 to 15 Yrs
Category: IT Software
Main location: Bangalore
Employment Type: Full Time
Job Summary:
We are seeking an experienced Data Engineering Lead that will be able to execute on a Cloudera Hadoop to cloud ETL migration of a very large number of data products. The ideal candidate will have deep expertise in AWS S3 AWS Glue debt and at least one Cloud Platform like Snowflake or Databricks along with strong skills in data warehousing ETL design and addition the ideal candidate will have experience leading multiple delivery teams offering guidance and support and ensuring quality delivery through thorough testing strategies. They will play a key role in ensuring that all data products across multiple client teams get delivered with high quality in a timely fashion.
Key Responsibilities
Execute on the Cloudera Hadoop to Cloud ETL migration of 500 data products
Prioritize plan track and ensure progress for 500 ETL migrations
Establish and enforce clients tool usage guidance and data engineering patterns
Lift & Shift SQL logic to the cloud with minimal technical adjustments
Ensure 100% data product quality and testing before delivery and deployment
Oversee and coordinate offshore development team of 9 to 12 data engineers
Work in partnership with multiple client data engineering teams (offshore/onshore)
Closely collaborate with cloud platform team and source data ingestion team
Effectively communicate with project coordinator and program manager
Report status to client management Escalate delays and roadblocks early
Comply with clients cloud data governance security and compliance patterns
Align with client data architects business analysts and engineering teams
Help develop basic AI tools to adjust ETL code to SQL dialect table and field names
Required Skills and Qualifications
12 years of experience in data engineering or related roles
Proven expertise in:
Leadership of Data Engineering Teams
AWS S3 AWS Glue dbt
One Cloud Platform like Snowflake or Databricks
Data warehousing design and optimization
Expert SQL skills (advanced queries performance tuning)
ETL processes and orchestration frameworks
Database management and data analysis
Code repositories such as GitHub for version control
Understanding of data governance security and compliance in cloud environments
CGI is an equal opportunity addition CGI is committed to providing accommodations for people with disabilities in accordance with provincial legislation. Please let us know if you require a reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.
Skills:
- Data Engineering
- Snowflake
- Azure Data Lake
- Data Modeling
- Python
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our teamone of the largest IT and business consulting services firms in the world.
Employment Type
Full-Time
