Greetings from MoxieIT
Azure Data Engineer - Assurance Analytics COE
Role: Senior Databricks Engineer
We are looking for a skilled Azure Data Engineer to design build and maintain scalable data pipelines and platforms on Microsoft Azure. You will work closely with data architects analysts and business stakeholders to enable reliable high-quality data for analytics and reporting.
Key Responsibilities
- Proven 4-5 years of experience as a Databricks engineer.
- Design and develop end-to-end data pipelines using Azure Data Factory (ADF) for ingestion transformation and orchestration
- Build and optimize ETL/ELT workflows in Azure Databricks using PySpark and Python
- Write complex SQL queries stored procedures and views for data transformation and reporting
- Manage and maintain Delta Lake tables following Medallion Architecture (Bronze / Silver / Gold)
- Implement and govern Unity Catalog for data discovery lineage access control and cataloging
- Work with NoSQL databases (MongoDB / Azure Cosmos DB) for semi-structured and high-throughput data scenarios
- Ensure data quality integrity and consistency across pipelines
- Optimize query performance and pipeline execution for large-scale datasets
- Collaborate with DevOps teams for CI/CD of data pipelines using Azure DevOps / Git
- Document data flows schemas and pipeline designs
Good-to-Have Skills
- Experience with Azure Synapse Analytics or Azure SQL Data Warehouse
- Familiarity with Azure Event Hub / Kafka for streaming data
- Knowledge of dbt (Data Build Tool) for transformation layer management
- Exposure to Power BI or other BI tools for data consumption layer
- Understanding of data mesh or data lakehouse architecture
- Experience with Terraform / ARM templates for infrastructure as code
- Familiarity with Git / Azure DevOps for version control and CI/CD
- Knowledge of Keycloak or Azure AD for data access security
- Exposure to Agile / Scrum delivery methodology
Greetings from MoxieIT Azure Data Engineer - Assurance Analytics COE Role: Senior Databricks Engineer We are looking for a skilled Azure Data Engineer to design build and maintain scalable data pipelines and platforms on Microsoft Azure. You will work closely with data architects analysts and...
Greetings from MoxieIT
Azure Data Engineer - Assurance Analytics COE
Role: Senior Databricks Engineer
We are looking for a skilled Azure Data Engineer to design build and maintain scalable data pipelines and platforms on Microsoft Azure. You will work closely with data architects analysts and business stakeholders to enable reliable high-quality data for analytics and reporting.
Key Responsibilities
- Proven 4-5 years of experience as a Databricks engineer.
- Design and develop end-to-end data pipelines using Azure Data Factory (ADF) for ingestion transformation and orchestration
- Build and optimize ETL/ELT workflows in Azure Databricks using PySpark and Python
- Write complex SQL queries stored procedures and views for data transformation and reporting
- Manage and maintain Delta Lake tables following Medallion Architecture (Bronze / Silver / Gold)
- Implement and govern Unity Catalog for data discovery lineage access control and cataloging
- Work with NoSQL databases (MongoDB / Azure Cosmos DB) for semi-structured and high-throughput data scenarios
- Ensure data quality integrity and consistency across pipelines
- Optimize query performance and pipeline execution for large-scale datasets
- Collaborate with DevOps teams for CI/CD of data pipelines using Azure DevOps / Git
- Document data flows schemas and pipeline designs
Good-to-Have Skills
- Experience with Azure Synapse Analytics or Azure SQL Data Warehouse
- Familiarity with Azure Event Hub / Kafka for streaming data
- Knowledge of dbt (Data Build Tool) for transformation layer management
- Exposure to Power BI or other BI tools for data consumption layer
- Understanding of data mesh or data lakehouse architecture
- Experience with Terraform / ARM templates for infrastructure as code
- Familiarity with Git / Azure DevOps for version control and CI/CD
- Knowledge of Keycloak or Azure AD for data access security
- Exposure to Agile / Scrum delivery methodology
View more
View less