Department of Health - Data Engineer
Department of Health - Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
The Data Engineer will spearhead the modernization of the enterprise data platform transitioning from Informatica ETL to a next-generation Azure Data Lake solution. This role involves assessing the current data environment identifying integration gaps designing a scalable cloud-native data architecture and supporting API-based data ingestion and ETL modernization.
- Lead architectural design and roadmap for migrating from Informatica-based ETL pipelines to Azure Data Lake Storage (ADLS Gen2).
- Assess current data workflows and integration points; identify performance security or scalability gaps.
- Design and oversee development of API-based integrations for real-time and batch data ingestion into the Azure data platform.
- Define data models metadata standards security policies and best practices for Azure Data Lake.
- Work closely with business analysts developers and platform engineers to align architecture with business needs.
- Provide architectural governance and mentorship to data engineering teams.
- Support data governance cataloging and lineage tools to ensure compliance and visibility across the ecosystem.
- Ensure high data quality performance optimization and resilience in the architecture.
- 10 years of experience in data architecture data integration and ETL design.
- Deep knowledge of Informatica PowerCenter with ability to analyze and transition legacy pipelines.
- Proven experience designing and building large-scale solutions using Azure Data Lake (ADLS Gen2).
- Strong experience in API development and integration RESTful APIs data services authentication models (OAuth2 etc.).
- Hands-on with Azure Data Factory Databricks Synapse Analytics or similar Azure-native data tools.
- Proficiency in one or more languages used for integration and transformation (e.g. Python .NET Java).
- Solid understanding of data modeling performance tuning and storage optimization in cloud environments.
- Strong communication and stakeholder engagement skills.
- Experience with enterprise data platform migration or cloud modernization projects.
- Knowledge of CI/CD and DevOps practices in data pipelines.
- Familiarity with data governance and cataloging tools like Azure Purview Collibra or Informatica EDC.
- Not specified.
- Not specified.
Employment Type
Full-time
