Databricks Developer

Position Description:

This role is hybrid and requires you to be at our clients and/or downtown Toronto office at a minimum 2 days per week - subject to change at any time.

We are seeking a skilled Databricks Developer to design develop and optimize scalable data solutions on the Databricks platform. The ideal candidate will be responsible for building and managing database schemas developing procedures for Operational Data Store (ODS) environments using Databricks Delta Lake tables and ensuring efficient data archiving and document indexing processes. The role requires strong expertise in data engineering cloud-based analytics platforms and data lifecycle management.

Your future duties and responsibilities:

. Design and develop database schemas and procedures for Operational Data Store (ODS) using Databricks Delta Lake tables.
. Build and maintain scalable ETL/ELT pipelines within the Databricks ecosystem.
. Define and implement data contracts for data archiving and document indexing processes.
. Ensure efficient and reliable data archiving retention and retrieval mechanisms.
. Develop and optimize document indexing strategies to improve data accessibility and search performance.
. Collaborate with business analysts architects and data teams to understand data requirements and translate them into technical solutions.
. Monitor and optimize data processing performance storage efficiency and query execution.
. Implement data quality governance and security standards across data platforms.
. Support troubleshooting performance tuning and production issue resolution.
. Maintain technical documentation for data models workflows and integration processes.

Required qualifications to be successful in this role:

Required Skills & Qualifications

. Strong experience with Databricks and Apache Spark.
. Hands-on expertise with Delta Lake architecture and table management.
. Proficiency in SQL and PySpark/Scala for data engineering solutions.
. Experience designing and implementing database schemas for enterprise data platforms.
. Knowledge of data archiving indexing strategies and data lifecycle management.
. Understanding of data contracts metadata management and governance principles.
. Experience with cloud platforms such as Azure AWS or GCP.
. Familiarity with ETL/ELT frameworks and data pipeline orchestration tools.
. Strong analytical troubleshooting and performance optimization skills.


Preferred Qualifications

. Experience working with large-scale enterprise data platforms.
. Knowledge of document management and indexing systems.
. Exposure to CI/CD practices and DevOps for data engineering.
. Databricks certification is a plus.


Education & Experience

. Bachelors degree in Computer Science Information Technology Data Engineering or related field.
. 3 years of experience in Databricks/Data Engineering development roles.

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $95000$145000. This role is an existing vacancy.

#LI-AV1

Skills:

• Apache Spark
• Azure
• Data Engineering
• Data Engineering
• Databricks
• English
• Financial Services
• Google Cloud Platform
• SQL

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.

To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our teamone of the largest IT and business consulting services firms in the world.