RQ09315 - Software Developer - ETL - Senior
RQ09315 - Software Developer - ETL - Senior
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
NOTE
Assignment Type: This position is currently listed as Hybrid and consultants will be required to work onsite at the work location 3 days a week and 2 days from home. The details of this arrangement will be confirmed with the Hiring Manager.
Extension/Amendment Attestation: Extension(s) only allowed using unused days/funds left on contract. No additional funds will be added beyond maximum contract value. The Statement of Work (SOW) shall expire on April 2 2026. HSC may exercise its option(s) to extend a SOW beyond April 2 2026 using unused days/funds left on the contract. Such extension(s) will be allowable only if the Master Service Agreement is extended beyond April 5 2026 and be upon the same terms conditions and covenants contained in the SOW.
Responsibilities:
We are seeking a highly skilled Software Developer with ETL implementation experience to join our data engineering team. This role is critical in ensuring the accuracy reliability and performance of our data pipelines and analytics infrastructure built on the Microsoft Azure platform and Databricks. Under the supervision of the IT QA Lead you will collaborate closely with data engineers and DevOps teams to design and implement robust data quality frameworks automated testing pipelines and CI/CD processes.
Design and implement comprehensive test plans for data pipelines and transformations in a Microsoft Azure Databricks and Power BI technology stack.
Conduct data quality assessments validation and profiling using tools like Great Expectations.
Develop and maintain automated testing frameworks integrated into CI/CD pipelines.
Collaborate with data engineers to ensure adherence to Medallion Architecture best practices.
Monitor and assess pipeline performance scalability and data integrity.
Implement and manage DevOps practices using Azure DevOps Git and related tools.
Document test cases validation rules and QA processes clearly and consistently.
Perform functional testing on Power BI Reports and dashboards
Participate in Agile ceremonies and contribute to sprint planning and retrospectives.
SkillsExperience and Skill Set Requirements
Public Sector Experience
5 years of experience working in the federal/provincial/broader publicsector as a software developer / data specialist / quality assurance tester
5 points
Core ETL Development Skill & Experience
5 years of experience in data engineering:
Must have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure Databricks and Power BI technology stack.
Must have strong knowledge and handson experience with:
Microsoft Azure Data Services (ADF ADLS Gen 2 Synapse Azure SQL)
Azure Databricks
PySpark and SQL
Power BI (data preparation modelling and visualization)
Must have demonstrated experience in developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps Git Visual Studio Code and related tools.
Demonstrated experience in collaborating with data engineers to ensure adherence to Medallion Architecture best practices (Staging Bronze Silver Gold layers)
Certifications (preferred but not required):
Microsoft Certified: Azure Data Engineer Associate
Databricks Certified Data Engineer Associate/Professional
Microsoft Certified: Fabric Analytics Engineer Associate
Microsoft Certified: Power BI Data Analyst Associate
Microsoft Certified: DevOps Engineer
75 points
Quality Assurance Skill & Experience
5 years of experience in quality assurance and automated testing:
Must have experience conducting software quality functional assessments systems testing performance evaluation automated testing using a variety of tools such as:
JIRA or Azure DevOps for defect tracking
Selenium for automated testing of webbased apps including Power BI reports and dashboards
JMeter for performance evaluation.
Conducting data quality assessments validation and profiling using tools like Great Expectations
Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps Git Visual Studio Code and related tools.
Certifications (preferred but not required):
Certified Software Tester (CSTE)
Certified Tester Test Automation Engineer.
20 points
MUST HAVES:
5 years of experience in data engineering:
Must have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure Databricks and Power BI technology stack.
Must have strong knowledge and handson experience with:
Microsoft Azure Data Services (ADF ADLS Gen 2 Synapse Azure SQL)
Azure Databricks
PySpark and SQL
Power BI (data preparation modelling and visualization)
Must have demonstrated experience in developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps Git Visual Studio Code and related tools
Must have experience conducting software quality functional assessments systems testing performance evaluation automated testing using a variety of tools such as:
JIRA or Azure DevOps for defect tracking
Selenium for automated testing of webbased apps including Power BI reports and dashboards
JMeter for performance evaluation.
Conducting data quality assessments validation and profiling using tools like Great Expectations
Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps Git Visual Studio Code and related tools.
Employment Type
Full Time
