Data Engineer Lead (Hybrid Work Schedule)

Data Engineer Lead

Location: Calgary Alberta Canada

Model of Work: Hybrid

Are you excited by challenges Do you enjoy working in a fast-paced international and dynamic environment Then now is the time to join Quorum Software a rapidly growing company and industry leader in oil & gas transformation.

Quorum Software is the worlds largest provider of digital technology focused solely on business workflows that empower the next evolution of energy. From emerging companies to supermajors throughout every region of the globe customers rely on Quorums proven innovation and unmatched global expertise to streamline business operations and make data-driven decisions that optimize profitability and growth. Our industry-leading solutions are transforming energy companies across the entire value chain helping visionary leaders evolve their organizations into modern energy companies.

Overview

We are looking for a Lead Data Engineer to join our data team and take ownership of building and scaling our enterprise data this role you will lead a team of engineers to design develop and deliver a robust production-grade data solution that serves multiple business segments and data domains.

You are someone who is equally comfortable architecting a medallion lakehouse writing a complex PySpark transformation mentoring a junior engineer and collaborating with data scientists to productionize models. You bring technical depth leadership experience and a genuine passion for clean reliable data.

Responsibilities

• Lead a team of data engineers through the full delivery lifecycle from architecture and design through to deployment and ongoing operations
• Design and implement scalable data pipelines that ingest transform and serve data across Bronze Silver and Gold layers using Medallion Architecture
• Build and maintain the organizations Databricks environment including Unity Catalog Delta Lake and Databricks Workflows
• Develop and maintain RESTful APIs that expose data assets to downstream consumers including analytics teams applications and external partners
• Own pipeline reliability establishing monitoring alerting data quality checks and SLA frameworks across all ingestion patterns
• Partner closely with Data Scientists to support feature engineering model training pipelines and the operationalization of ML models into production
• Define and enforce data engineering standards coding conventions and peer review practices across the team
• Collaborate with Data Architects and Analytics Engineers to evolve the centralized data model and ensure consistency across segments
• Champion data governance practices including lineage tracking metadata management and access control using Azure Purview and Unity Catalog
• Partner closely with our Product leaders to help guide and design needed data solutions.
• And other duties as assigned.

Requirements

Leadership & Delivery

• 3 years leading a data engineering team or serving as a technical lead on a major data platform initiative
• Demonstrated experience delivering an end-to-end data solution from requirements through production across a complex multi-source environment
• Ability to manage competing priorities communicate technical decisions to non-technical stakeholders and keep a team aligned and productive

Databricks & Lakehouse

• Deep hands-on experience with Databricks or similar tools including Delta Lake Unity Catalog Databricks Workflows and cluster/job optimization
• Strong understanding of Medallion Architecture (Bronze / Silver / Gold) and how to apply it pragmatically across different data domains
• Proficiency in PySpark and Spark SQL for large-scale data transformation

Data Pipelines & Ingestion

• Experience building and maintaining pipelines across multiple ingestion patterns APIs CDC file-based streaming (Kafka Event Hubs) and batch
• Familiarity with orchestration tools such as Apache Airflow Databricks Workflows or Azure Data Factory
• Strong understanding of pipeline reliability patterns: idempotency incremental loading schema evolution and error handling

API Development

• Proven experience designing and building RESTful APIs to expose data assets including authentication versioning rate limiting and documentation
• Familiarity with FastAPI Flask or similar Python-based API frameworks
• Understanding of API gateway patterns within Azure (Azure API Management)

SQL & Azure

• Expert-level SQL skills including window functions CTEs query optimization and data modeling
• Hands-on experience with the Azure data ecosystem: Azure Data Lake Storage Gen2 Azure Data Factory Azure Synapse Analytics Azure Purview Azure Key Vault and Azure DevOps
• Understanding of Azure networking IAM and security patterns as they apply to data platform architecture

Data Science Collaboration

• Solid grounding in data science concepts feature engineering model training workflows experiment tracking and ML model deployment
• Experience supporting or building MLflow-based experiment tracking and model registries within Databricks
• Ability to translate data science requirements into reliable scalable data infrastructure

Preferred Skills

• Experience with Microsoft Fabric and Microsoft OneLake
• Experience in the Oil & Gas or energy industry particularly with operational production or field data
• Familiarity with dbt (data build tool) for analytics engineering workflows
• Exposure to real-time / streaming data patterns using Kafka MQTT or Azure Event Hubs
• Experience with Terraform or Bicep for infrastructure-as-code on Azure
• Knowledge of data mesh principles and federated data ownership models

What Success Looks Like in Year One

• A production-grade Medallion Architecture is live on Databricks serving data from multiple business segments
• Pipelines are reliable monitored and documented the team spends more time building than firefighting
• APIs are in use by downstream consumers internally and externally with clear ownership and versioning
• The team has a consistent engineering culture with defined standards review processes and a healthy backlog
• Data Scientists have a faster path from experimentation to production

About You

You dont just write good code you make the people around you better engineers. You care about data quality not because its in your job description but because bad data has real consequences. Youre pragmatic about perfection and know when to ship versus when to refactor. And youre excited about building something that genuinely changes how a business understands itself.

Additional Details

• Background Check: The successful candidate will need to successfully complete the following clearances: Criminal History Check Education Verification Employment Verification Drivers License Verification and passport/ID validation.
• Visa Sponsorship: Employment eligibility to work with Quorum Software in Canada is required as the company will not pursue visa sponsorship for this position. The successful candidate will be required to ensure they maintain and renew any visas or permits that grant employment eligibility where applicable.

About Quorum Software
Quorum Software connects people and information across the energy value chain. Twenty years ago we built the first software for gas plant accountants. Pipeline operators came next followed by land administrators pumpers and planners. Since 1998 Quorum has helped thousands of energy workers with business workflows that optimize profitability and growth. Our vision for the future connects the global energy ecosystem through cloud-first software data standards and integration. The trusted source of decision-ready data for 1800 companies Quorum Software makes the essential connections that let us work better together in the connected energy workplace. For more information visit.

Quorum Diversity Statement:At Quorum we are committed to fosteringcultivatingand preserving a culture of belonging. We want to be the place where a diverse pool of talented peoplejoinus stay with us and do their best work. With a diverse team of employees we grow and learn better together. The collective sum of the individual differences life experiences knowledge innovation self-expression and talent that our employees invest in their work represents not only part of our culture but our reputation and our achievements. We are fully focused on equity and equality and believe deeply in diversity of race gender sexual orientation age religion ethnicity national origin ability neurodiversity and all the other characteristics that make us unique.

Quorum Business Solutions and Quorum Software are Equal Opportunity Employers. All qualified applicants will receive consideration for employment without regard to race color religion age sex sexual orientation gender identity national origin ancestry veteran status disability genetic information or any other basis protected by law.

Those applicants requiring reasonable accommodation to the application and/or interview process should notify a member of the Human Resources Department

Recruitment Scam Alert: Quorum Software does not charge fees request payments conduct interviews via messaging apps or request the installation of software at any stage of the recruitment process. All legitimate recruitment activities are conducted exclusively through our official careers website ( and email addresses ending in @. Any communication that does not originate from these official channels should be considered unauthorized and may be reported to emailprotected