Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
23 hours ago
Vacancies:
1 Vacancy
Job Summary
Position Description:
The Senior Data Engineer is responsible for designing building and optimizing scalable data pipelines and cloud based data solutions on Google Cloud Platform (GCP). This role involves working closely with data architects analysts and cross-functional teams to enable reliable data flows real-time streaming and advanced analytics. The ideal candidate has deep expertise in GCP services such as Pub/Sub Dataflow and BigQuery with a strong background in distributed data processing and data modeling
Your future duties and responsibilities:
Design and develop scalable ETL/ELT data pipelines using GCP services such as Dataflow and BigQuery.
Build and maintain real time streaming solutions leveraging Pub/Sub and Dataflow.
Optimize data pipelines and workflows for performance reliability and cost efficiency.
Architect end to end cloud based data solutions on GCP aligned with business and technical requirements.
Implement data security governance and quality best practices across all data environments.
Automate infrastructure and pipeline deployments using CI/CD and Infrastructure-as-Code (e.g. Terraform).
Design and maintain data models and warehouses in BigQuery including proper partitioning and clustering.
Collaborate with cross-functional teams (analysts data scientists architects) to translate business needs into technical data solutions.
Troubleshoot monitor and improve data pipelines to ensure reliable and timely data delivery.
Mentor junior engineers and contribute to best practices coding standards and architectural guidelines.
Required qualifications to be successful in this role:
6 years of experience in data engineering or similar roles.
Strong expertise with Google Cloud Platform including:
Pub/Sub (event streaming message ingestion)
Dataflow (batch & streaming pipelines Apache Beam)
BigQuery (SQL performance tuning partitioning clustering)
Proficiency in Python SQL and data pipeline frameworks.
Experience with distributed systems data ingestion and processing at scale.
Knowledge of CI/CD pipelines version control and automation tools.
Strong understanding of data modeling warehousing concepts and ETL/ELT design principles.
CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $70000$135000. This role is a future opportunity
#LI-OA1
Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.
Skills:
- Google Cloud Platform
- Python
- SQL
What you can expect from us:
Together as owners lets turn meaningful insights into action.
Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.
Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.
Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.
To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.
Come join our teamone of the largest IT and business consulting services firms in the world.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
The COMPANY is one of the few end-to-end consulting firms with the scale, reach, capabilities and commitment to meet clients’ enterprise digital transformation needs. Our 77,500 consultants and professionals work side-by-side with clients in 10 industries across more than 400 location ... View more
