Job Description:
We are looking for an experienced Azure Data Engineer with a strong background in the banking or financial services domain to design build and maintain robust data pipelines and solutions on the Azure cloud platform. The ideal candidate should have hands-on expertise in Azure data services deep understanding of financial datasets and regulatory data and strong collaboration skills to work with data scientists analysts and business teams.
Key Responsibilities:
- Design and implement scalable secure and high-performance data solutions using Azure Data Factory Azure Synapse Azure Data Lake and Databricks
- Develop and optimize ETL/ELT pipelines for large-scale structured and unstructured data across banking products (loans deposits credit risk treasury etc.)
- Work with stakeholders to understand data requirements perform data profiling cleansing and validation
- Develop and maintain data models (star/snowflake schemas) data catalogs and data dictionaries
- Ensure data integrity security lineage and compliance with banking regulatory standards (e.g. Basel III BCBS 239 AML/KYC IFRS)
- Collaborate with DevOps teams to automate deployments and monitoring of data pipelines
- Support ad hoc queries reporting and integration with BI tools like Power BI
- Troubleshoot and resolve performance data quality and integration issues
- Mentor junior engineers and participate in code reviews and data governance processes
Required Skills:
- 10 years of experience in data engineering or data warehousing
- 3 years of hands-on experience with Azure data services:
- Azure Data Factory
- Azure Synapse Analytics
- Azure Data Lake Gen2
- Azure SQL Database / SQL Managed Instance
- Databricks / Spark
- Strong experience in SQL Python and PySpark
- Proven knowledge of banking data models core banking systems or risk and compliance datasets
- Understanding of data governance data security and regulatory compliance
- Familiarity with CI/CD tools and infrastructure-as-code (IaC) like ARM templates Terraform or Bicep
- Experience with version control (Git) Agile/Scrum and Jira/Confluence
Preferred Qualifications:
- Experience in data migration or modernization projects in large financial institutions
- Knowledge of machine learning pipelines and integration with ML services on Azure
- Certifications such as:
- Microsoft Certified: Azure Data Engineer Associate
- Azure Fundamentals
- Certified Banking Professional (optional).