Azure Data Engineer

Azure Data Engineer

Location: New York NY
Employment Type: Contract

Job Summary

STAFFXPERT LLC is seeking an Azure Data Engineer on behalf of our client in New York NY. The ideal candidate will have strong expertise in Azure cloud technologies Databricks and enterprise data engineering. This role involves designing scalable data solutions developing high-performance ETL/ELT pipelines and supporting advanced analytics and business intelligence initiatives within a secure cloud environment.

Key Responsibilities

• Design develop and maintain scalable data solutions on Microsoft Azure

• Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks

• Develop and manage enterprise data lake solutions using Azure Data Lake Storage (ADLS)

• Implement Spark-based data processing solutions for large-scale datasets

• Create dashboards and reporting solutions using Power BI

• Ensure data quality governance lineage and compliance standards are maintained

• Collaborate with cross-functional teams including analytics engineering and business stakeholders

• Optimize SQL queries data models and overall pipeline performance

• Implement secure cloud data architectures and Azure security best practices

Required Qualifications

• Strong hands-on experience with Azure Data Factory (ADF)

• Expertise in Azure Databricks and Apache Spark

• Experience with Azure Data Lake Power BI and SQL

• Advanced SQL development and query optimization skills

• Experience designing scalable ETL/ELT pipelines

• Strong understanding of Azure security concepts including IAM RBAC encryption and secure data communication

• Experience with data governance metadata management and data lineage

• Databricks Certified Data Engineer Associate certification

Preferred Qualifications

• Experience with Azure Synapse Analytics Azure Cosmos DB or Azure Machine Learning

• Knowledge of serverless Azure architecture

• Experience / C# is a plus

• Azure certifications such as Azure Security Engineer Associate or Azure Solutions Architect Expert preferred

• Prior experience in enterprise or regulated industry environments is a plus