Job Overview:
We are urgently looking for a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate must have a solid background in Azure Data Factory (ADF) Databricks PySpark and strong hands-on experience with modern data tools and platforms. This is a client-facing role requiring excellent communication skills flexibility and strong problem-solving capabilities.
Key Responsibilities:
- Design build and maintain scalable data pipelines and ETL processes using Azure Data Factory and Databricks
- Develop and optimize PySpark jobs for large-scale data processing
- Integrate various data sources into a unified data lake/warehouse environment
- Implement data governance practices using Unity Catalog and manage metadata effectively
- Work closely with stakeholders to understand business requirements and translate them into technical solutions
- Monitor troubleshoot and improve existing data workflows and performance
- Collaborate with BI developers to support Power BI reporting and dashboards
- Utilize Azure DevOps (ADO) for CI/CD pipelines and version control
Must-Have Skills:
- Azure Data Factory (ADF) Advanced knowledge
- Azure Platform End-to-end data engineering experience
- Databricks & PySpark Strong development experience
- SQL Excellent query optimization and data manipulation skills
- Azure DevOps (ADO) Familiar with CI/CD practices
- Power BI Ability to support data modeling and integration
- Unity Catalog Hands-on experience in metadata and data governance
- Excellent Communication Skills Verbal and written must be client-facing ready
Preferred Qualifications:
- Azure Data Engineer or Azure Architect Certification
- Previous experience in Agile environments
- Exposure to data security and compliance practices in Azure
- Strong problem-solving and analytical thinking
Required Experience:
Senior IC