Databricks Engineering Consultant

Position Description:

CGI is the worlds 5th largest independent IT and business consulting services firm operating across 40 countries and delivering more than 100 IP-based solutions to clients in Financial Services Government Healthcare Manufacturing Utilities Oil & Gas and more. We are recognized globally for our on-time on-budget delivery and our role as a trusted advisor to leading organizations.
As organizations accelerate their data and analytics modernization CGI is expanding its Data & AI consulting practice. We are seeking a Databricks Engineering Consultant with strong expertise in Databricks platform administration Spark performance optimization and secure reliable operations.
Join our team and help operate and scale enterprise-grade analytics platforms that deliver reliable high-performance data solutions.

Your future duties and responsibilities:

As a Databricks Engineering Consultant you will be responsible for the configuration management and operational excellence of Databricks environments. This includes managing workspaces clusters compute pools libraries and security configurations as well as optimizing Apache Spark performance to ensure efficient and cost-effective data processing.
You will work closely with Data Architects Cloud Architects and Security teams to ensure Databricks platforms are secure performant scalable and compliant with enterprise operational standards.

Key Responsibilities
Databricks Platform Administration

. Configure and manage Databricks workspaces including environments for development testing and production.
. Provision configure and optimize clusters and compute pools to balance performance reliability and cost.
. Manage Databricks runtime versions cluster policies and job configurations.
. Administer libraries and dependencies ensuring consistent and reliable runtime environments.

Spark Performance & Optimization

. Monitor and tune Apache Spark workloads including memory management partitioning caching and execution plans.
. Identify and remediate performance bottlenecks in batch and streaming workloads.
. Collaborate with data engineering teams to optimize Spark code and pipeline execution.
. Implement best practices for cost optimization and resource utilization.

Security Governance & Operational Controls

. Enforce workspace security policies including access controls permissions and cluster policies.
. Support integration with enterprise identity providers and role-based access models.
. Implement operational standards for logging monitoring and alerting.
. Ensure Databricks environments comply with enterprise security privacy and operational governance requirements.

Cloud & Platform Integration

. Integrate Databricks with cloud-native services such as Azure Data Lake Storage Azure Key Vault and networking components.
. Support secure connectivity patterns and secret management.
. Collaborate with Cloud Architects on infrastructure design and optimization.

Delivery & Collaboration

. Partner with Data Architects and Data Engineers to support reliable deployment and execution of data pipelines.
. Participate in platform design discussions providing operational and performance perspectives.
. Contribute to documentation runbooks and operational standards.
. Provide guidance and mentorship on Databricks operational best practices

Required qualifications to be successful in this role:

Must-Have Technical Experience

. 510 years of experience in data engineering platform engineering or cloud data operations including: Databricks workspace and cluster administration Apache Spark performance tuning Compute pools jobs and scheduling Library and dependency management
. Strong experience with Cloud platforms (Azure preferred).
. Hands-on experience with monitoring troubleshooting and operational support of data platforms.
. Solid understanding of security access controls and operational governance.

Industry Experience

. Experience supporting data platforms in enterprise or regulated environments such as Energy Utilities Financial Services or Government is an asset.

Consulting & Collaboration Skills

. Ability to work effectively in client-facing environments.
. Strong communication skills to collaborate with architects engineers and stakeholders.
. Experience working in Agile delivery teams.

Additional Assets

. Experience with Delta Lake and Databricks Jobs.
. Familiarity with CI/CD and DataOps practices.
. Experience with monitoring and observability tools.
. Knowledge of cost management and optimization in cloud environments.

Education & Certifications

. Bachelors degree in Computer Science Engineering Data Science or a related field.
. Databricks certifications (e.g. Databricks Data Engineer Databricks Platform Administrator) are a strong asset.
. Cloud certifications (Azure) are an asset.

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes various factors including but not limited to skill set level geographic market experience and training and licenses and certifications. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $85000 - $150000.

Why CGI
At CGI you will play a critical role in ensuring the reliability and performance of enterprise analytics platforms for some of Canadas most complex organizations. You will work in a collaborative ownership-driven culture while building deep expertise in modern data platforms.
Learn more .

#LI-AP1

Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

Skills:

• Apache Spark
• Data Analysis
• GIT
• GIT
• SQL

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.

To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our teamone of the largest IT and business consulting services firms in the world.