Senior Azure Data Engineer
Senior Azure Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Position Description:
Challenge yourself and change lives unlocking complex system solutions as part of a highly motivated and supportive team. Our Data Engineers are trusted to work closely with a wide range of clients on exciting projects with realworld purpose and impact.
CGI was recognised in the Sunday Times Best Places to Work List 2023 and has been named one of the Worlds Best Employers by Forbes magazine. We offer a competitive salary excellent pension private healthcare plus a share scheme 3.5 3.5 matching) which makes you a Partner not just an employee.
CGI are on the hunt for a dynamic Senior Data Engineer to join our consulting team and drive innovative highimpact data transformation solutions for our diverse client base. In this role you will design build and optimize robust ETL pipelines and staging systems for complex data migration projects using Azure Data Factory and Azure Databricks while also integrating key Google Cloud Platform services such as BigQuery Cloud Dataflow and Cloud Dataproc. Your extensive experience in processing largescale data managing millions of customer records and developing Sparkbased transformations will be crucial in converting legacy data models into structured actionable insights.
Your future duties and responsibilities:
In addition to your technical expertise you will work closely with data architects and client stakeholders to ensure alignment with target data models and drive seamless data migrations. Your role will involve automating cleansing workflows implementing data quality frameworks and troubleshooting issues to maintain data integrity. The ideal candidate will have a strong multicloud background deep technical skills and proven consulting experience enabling you to deliver tailored strategic solutions that propel business transformation and client success.
Required qualifications to be successful in this role:
Strong experience in ETL development data pipeline automation and largescale data processing.
Proficiency in Azure Data Factory (ADF) for orchestrating data workflows and extensive handson experience with Azure Databricksincluding cluster management notebook development and performance optimizationfor scalable data transformations.
Familiarity with Google Cloud Platform servicessuch as BigQuery Cloud Dataflow and Cloud Dataprocin multicloud environments is highly advantageous.
Proven track record in developing utilizing and optimizing staging systems to manage complex data cleansing transformation and migration requirements.
Expertise in processing millions of customer records using SQLbased transformations and Sparkbased frameworks (Python Scala or SQL) across platforms like Azure Databricks Azure Synapse or equivalent environments.
Strong knowledge of data quality frameworks validation techniques and error handling to ensure highintegrity data processes.
Experience working with structured and semistructured data (JSON Parquet Avro CSV etc. in migration contexts and a deep understanding of legacy versus target data models.
Ability to optimize data cleansing and transformation processes for improved efficiency and performance.
Want to learn more about careers at CGI Join our talent network
#LINP1
Skills:
- English
- Python
- SQL
- Google Cloud Platform
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and wellbeing and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our teamone of the largest IT and business consulting services firms in the world.
Required Experience:
Senior IC
Employment Type
Full-Time
