Azure Data Engineer
Job Location:
Salary:
Experience Required:
Posted on:
14 days ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
We are seeking a skilled Azure Data Engineer to design develop and maintain scalable cloud-based data solutions on the Microsoft Azure platform. The ideal candidate will have expertise in data integration ETL/ELT pipelines big data technologies and cloud data warehousing to support analytics and business intelligence initiatives.
Key Responsibilities
- Design and implement scalable data pipelines using Azure services.
- Develop and maintain ETL/ELT workflows for structured and unstructured data.
- Build and optimize data solutions using Azure cloud technologies.
- Integrate data from multiple sources including APIs databases flat files and streaming platforms.
- Create and manage data lakes data warehouses and medallion architectures.
- Ensure data quality governance security and compliance standards.
- Monitor and troubleshoot production data workflows and performance issues.
- Collaborate with data analysts DevOps and business stakeholders.
- Implement CI/CD pipelines and infrastructure automation for data platforms.
- Optimize SQL queries and improve overall data processing performance.
Requirements
Technical Skills
- Strong experience with:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS)
- Azure SQL Database
- Azure Functions
- Azure Event Hub / Service Bus
- Azure Data Factory (ADF)
- Proficiency in:
- SQL
- Python / PySpark
- Scala (optional)
- SQL
- Experience with:
- ETL/ELT pipeline development
- Data modeling and warehousing concepts
- Spark-based distributed processing
- REST APIs and data integration
- Git CI/CD and DevOps practices
- ETL/ELT pipeline development
Benefits
Standard Company Benefits
Required Skills:
Azure Databricks Pyspark python
Required Education:
Any other degree
