drjobs Senior Data Engineer -Apache Kafka, Apache Iceberg and Snowflake.

Senior Data Engineer -Apache Kafka, Apache Iceberg and Snowflake.

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Halifax - Canada

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Position Description:

This is an exciting time for CGI and we want you to be part of it. We are Canadas largest independent information technology services firm and we are still growing! We are expanding in Atlantic Canada and we need your skills enthusiasm and dedication as part of our team. We are seeking highly skilled Data Engineers to join our dynamic team. In this role you will be responsible for managing and optimizing the data infrastructure implementing data governance frameworks and developing real-time data streaming solutions. This role requires expertise in a variety of data management tools and technologies including but not limited to Apache Iceberg Kafka Python and Snowflake. If you are enthusiastic about data and have a strong background in data architecture and AI/ML we would love to hear from you.

Your future duties and responsibilities:

As a Data Engineer your responsibilities will be:

1. Design implement and maintain efficient scalable data pipelines using Apache Kafka SnapLogic and Python.
2. Develop and manage modern Lakehouse architectures with Apache Iceberg and Snowflake Data Warehouse.
3. Collaborate with stakeholders to gather requirements and implement solutions aligned with business goals.
4. Maintain data governance quality and reliability standards across all systems.
5. Work with Snowflake to optimize storage and query performance across large datasets.
6. Integrate AI/ML pipelines into data workflows and collaborate with data science teams.
7. Use Jira and Jira Align to manage project tasks backlog grooming and roadmap alignment.
8. Continuously evaluate and adopt new technologies and tools to improve data infrastructure.
9. Optimize the performance of data systems and applications.
10. Create and maintain comprehensive documentation for data processes and systems.
11. Provide training and support to team members on data tools and best practices.
12. Collaborate with cross-functional teams to understand data needs and deliver solutions.
13. Stay updated with the latest industry trends and technologies.

Required qualifications to be successful in this role:

1. 6-9 or 10 years of proven experience with the listed technologies and tools.
2. Strong hands-on experience with Apache Kafka and Apache Iceberg.
3. Experience working with Snowflake and Snowflake Data Warehouse technologies.
4. Familiarity with modern Lakehouse architectures and best practices.
5. Proficiency in Python for data engineering and pipeline automation.
6. Hands-on experience with SnapLogic or similar ETL tools.
7. Exposure to AI/ML workflows and integration of models into data systems.
8. Proficiency with Jira and Jira Align for project and portfolio management.
9. Solid understanding of data modeling data warehousing and data governance.
10. Excellent problem-solving skills and attention to detail.
11. Excellent communication and interpersonal skills.
12. Ability to work independently and in a team-oriented environment.
13. Strong opinions lightly held Willingness to own research and argue your points of view bring new ideas to the table but deliver according to consensus and expectations.

Required Level of Education (include certifications):

1. University or Technical Diploma in IT discipline with equivalent experience.
2. Experience with CI/CD practices in a data engineering environment.
3. Experience with Cloud data services (Azure GCP AWS) and/or Snowflake is desired.
4. Familiarity with cloud platforms (AWS Azure or GCP) and their data services.
5. Relevant certifications for this role will be nice to have.

Soft Skills:

1. Excellent communicator
2. Well organized
3. Detail orientated
4. Team Player

#LI-OA1

Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

Skills:

  • Apache Kafka
  • English
  • Jira
  • Python
  • Snowflake

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process please let us know. We will be happy to assist.

Come join our teamone of the largest IT and business consulting services firms in the world.


Required Experience:

Senior IC

Employment Type

Full-Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.