Data Engineering Specialist
Job Summary
Position Description:
We are seeking an experienced Data Engineer to design build integrate and support modern cloud-based data platforms and scalable data engineering solutions. The successful candidate will work across Google Cloud Platform (GCP) Microsoft Azure and Databricks environments to develop robust data pipelines data integration frameworks and cloud-native solutions that support enterprise analytics reporting and operational workloads.
This role requires strong expertise in cloud data services distributed data processing event-driven architectures data integration and DevOps practices. The ideal candidate is passionate about delivering scalable secure and high-performance data solutions in an Agile environment.
Your future duties and responsibilities:
Design develop and maintain cloud-based data platforms and data engineering solutions.
Build scalable ETL/ELT pipelines using modern cloud technologies and data processing frameworks.
Develop and optimize data solutions using GCP Azure and Databricks services.
Integrate enterprise applications databases APIs and event-streaming platforms.
Develop data models and optimize large-scale data storage and processing solutions.
Build and maintain RESTful APIs microservices and event-driven architectures.
Implement secure reliable and high-performing cloud-native data solutions.
Collaborate with cross-functional teams including architects developers analysts and business stakeholders.
Support CI/CD pipelines automated deployments and DevOps best practices.
Perform unit integration and automated testing to ensure solution quality.
Produce technical documentation and contribute to Agile ceremonies and project delivery
Required qualifications to be successful in this role:
5 years of experience in Data Engineering or a related role.
Strong experience building cloud-based data platforms and ETL/ELT pipelines.
Hands-on experience with Google Cloud Platform (GCP) services including BigQuery Dataflow DataProc Cloud SQL Cloud Spanner Cloud Storage and Composer.
Experience with Databricks including Lakehouse architecture Unity Catalog and MLflow.
Experience with Azure Data Factory and Azure SQL.
Strong SQL skills and experience with relational databases such as PostgreSQL Oracle and Google Spanner.
Experience with event streaming technologies including Kafka and Google Cloud Pub/Sub.
Proficiency in Python Apache Spark Hadoop and Talend.
Experience developing RESTful APIs microservices and event-driven architectures using Java and Spring Boot.
Experience with cloud-native technologies including Docker Kubernetes (AKS/GKE) Cloud Run and Azure Functions.
Experience with Git GitHub Bitbucket CI/CD pipelines JIRA and Confluence.
Knowledge of Agile delivery automated testing secure coding and software development best practices.
Preferred Qualifications
Experience building enterprise-scale cloud-native data platforms.
Knowledge of data governance and metadata management.
Experience with CI/CD automation and Infrastructure as Code.
Experience working within Agile/Scrum teams.
Excellent analytical problem-solving and communication skills.
Technical Environment
Cloud: Google Cloud Platform (GCP) Microsoft Azure
Data: Databricks BigQuery Cloud SQL Cloud Spanner Azure SQL Azure Data Factory
Programming: Python Java Apache Spark Hadoop
Integration: Kafka Cloud Pub/Sub REST APIs Spring Boot
Containers: Docker Kubernetes (AKS/GKE) Cloud Run
DevOps: GitHub Bitbucket GitHub Actions Bitbucket Pipelines
Methodology: Agile CI/CD Clean Architecture Domain-Driven Design (DDD).
CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $60000$120000. This role is an existing vacancy.
#LI-OA1
Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.
Skills:
- Java
- Microsoft Azure Data Factory
- Python
- Spring Boot
- SQL
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.
That same commitment to fairness extends to how we use technology. To support our recruitment team AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.
To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.
Come join our teamone of the largest IT and business consulting services firms in the world.
Required Experience:
IC
About Company
The COMPANY is one of the few end-to-end consulting firms with the scale, reach, capabilities and commitment to meet clients’ enterprise digital transformation needs. Our 77,500 consultants and professionals work side-by-side with clients in 10 industries across more than 400 location ... View more