Software Developer ETL Senior

Job Title: Software Developer - ETL - Senior
Location: Toronto Ontario
Work Model: Onsite
Security Clearance: CRJMC Credit Check

Description / Responsibilities / Skills

Description

Scope

• Support OPGT Modernization program for data migration and reporting initiatives
• Migrate digital files to OpenText document management solution
• Migrate historical data from legacy systems to Azure data warehouse or lakehouse
• Build data assets and develop reporting solutions

Assignment Deliverables

Data Warehouse Design

• Analyze business requirements and design data warehouse lakehouse architecture

Data Extraction

• Identify and extract data for migration to warehouse or document management solution

Data Integration and ETL

• Develop and automate ETL processes for data ingestion across bronze silver and golden layers

Digital File Migration

• Migrate digital files to OpenText enterprise document storage

Data Modeling

• Create logical and physical data models

Data Security and Governance

• Apply security controls and ensure compliance

Reporting and Visualization

• Develop PowerBI reports dashboards and visualizations
• Ensure data accuracy and integrity

Performance Optimization

• Optimize queries and reporting performance

Additional Responsibilities

• Deliver work within assigned timelines
• Identify and report issues and risks
• Follow government security and architecture standards
• Provide knowledge transfer to stakeholders

Skills

Experience and Skill Set Requirements

Mandatory Requirements

• 5 years experience in ETL development and data pipeline design
• Strong understanding of ETL principles data extraction transformation and loading
• Experience with Azure workflow orchestration and data pipeline architecture
• Proficiency in Azure Synapse including pipelines data flows triggers and monitoring
• Knowledge of Dynamics integration tools including Dataverse CDS Data Entities and APIs
• Experience working with Dynamics 365 CE and F&O data

Desired Skills and Experience

• Experience integrating on-premises and cloud data sources using Azure ETL services
• Expertise in data transformation data cleansing aggregation and enrichment
• Knowledge of data quality validation and governance practices
• Experience with privacy and data protection in Azure environments
• Strong SQL skills and experience with Azure SQL databases
• Experience with Azure storage technologies
• Experience with Python PowerShell or Azure CLI scripting
• Expertise in TSQL PLSQL data modelling and query optimization
• Experience with version control tools such as Azure Repos
• Experience with Azure DevOps and CI CD processes
• Experience with Synapse workspaces and data management tools
• Experience with data modeling tools

Evaluation Criteria

Criteria 1 ETL 30 Points

• Experience with ETL development data pipelines and workflow orchestration
• Experience integrating multiple data sources cloud and on-prem
• Experience with Azure Synapse pipelines and data flows
• Experience with SQL and performance tuning
• Experience with scripting languages Python PowerShell
• Experience with data modeling and SDLC

Criteria 2 Azure Platform 20 Points

• Experience with Azure Synapse Workspaces
• Knowledge of Azure data management tools and DevOps
• Experience with Azure Data Lake Blob Storage Key Vault
• Familiarity with Azure cloud platform
• Azure certifications considered an asset

Criteria 3 Dynamics 365 CE and F&O 30 Points

• Experience with Dataverse CDS Data Entities and APIs
• Experience working with Dynamics 365 CE and F&O data

Criteria 4 DevOps and CI CD 20 Points

• Experience with CI CD pipelines and DevOps practices
• Experience managing data workflows and deployment processes

Knowledge Transfer

What needs to be KT
Document tasks performed and in progress including ETL development and migration activities

To whom
Project Manager Team Members