Azure Data Factory Lead
Share
Job Location:
Monthly Salary:
Posted on:
8 hours ago
Vacancies:
1 Vacancy
Job Summary
$75/hour
We are seeking an experienced Azure Data Factory Lead with migration experience to oversee endtoend data integration orchestration and cloud-based ETL workflows using Azure services. This onsite role requires hands-on expertise in Azure Data Factory Azure Data Bricks Data Lake and modern data engineering practices. The ideal candidate will lead solution design for Informatica workflow to ADF guide development teams and collaborate closely with business stakeholders to deliver scalable and secure data pipelines.
Key Responsibilities
1. Solution Design & Architecture
Required Skills & Experience
Technical Skills
Preferred Qualifications
We are seeking an experienced Azure Data Factory Lead with migration experience to oversee endtoend data integration orchestration and cloud-based ETL workflows using Azure services. This onsite role requires hands-on expertise in Azure Data Factory Azure Data Bricks Data Lake and modern data engineering practices. The ideal candidate will lead solution design for Informatica workflow to ADF guide development teams and collaborate closely with business stakeholders to deliver scalable and secure data pipelines.
Key Responsibilities
1. Solution Design & Architecture
- Lead the design and architecture of enterprise-grade ETL/ELT pipelines using Azure Data Factory (ADF).
- Define and implement data ingestion patterns from on-prem SaaS and cloud sources.
- Architect data solutions leveraging Azure Data Lake Storage (ADLS) Azure Synapse Analytics SQL Database Databricks etc.
- Ensure security scalability and performance best practices across data workflows.
- Understand Informatica workflows and design migration of workflows into Azure Data Factory
- Build and optimize complex data pipelines data flows and orchestrations in ADF.
- Develop reusable templates frameworks and automation scripts.
- Implement CI/CD for ADF using Git repos and Azure DevOps pipelines.
- Perform systematic testingunit functional integrationof data pipelines.
- Lead and mentor a team of data engineers and developers.
- Work directly with business SMEs product owners and project managers.
- Translate business requirements into technical solutions.
- Provide daily technical guidance and ensure project delivery quality.
- Oversee pipeline performance monitoring alerting and troubleshooting.
- Establish governance standards for data quality lineage and metadata management.
- Ensure compliance with enterprise and regulatory standards (PII GDPR etc.).
Technical Skills
- 10 years of experience in Data Engineering with 6 years specifically in Azure.
- Strong expertise in:
- Azure Data Factory (pipelines data flows triggers integration runtimes)
- Azure Data Lake Storage (ADLS Gen2)
- Azure Synapse Analytics (SQL pools notebooks)
- Azure SQL / SQL Server / T-SQL
- Azure DevOps (Repos Pipelines CI/CD)
- Data modeling & data warehousing principles (Star schema SCDs)
- Experience integrating with APIs REST endpoints Flat files Databases SAP or ERP sources.
- Good understanding on Informatica workflow
- Good understanding of Databricks / PySpark is a plus.
- Strong communication and stakeholder-management skills.
- Ability to lead teams and coordinate across onsiteoffshore models.
- Problem-solving mindset and ownership-driven.
- Microsoft Azure certifications (DP-203 DP-900 etc.)
- Experience with agile methodologies.
