- Design and implement scalable data pipelines and data processing solutions using Azure and Microsoft Fabric
- Develop and optimize ETL/ELT processes for large-scale datasets
- Work with Lakehouse architectures (Medallion Bronze Silver Gold) using Fabric or Azure Databricks
- Integrate data from multiple sources using Azure Data Factory / Fabric Data Pipelines
- Build and maintain data models and Lakehouse structures in OneLake
- Ensure data quality reliability and performance across the platform
- Optimize Spark workloads and data transformations using PySpark and SQL
- Collaborate with Data Architects BI teams and Data Scientists to enable analytics and reporting
- Contribute to DataOps practices CI/CD pipelines and automation
- Support data governance and security best practices across the platform
Qualifications :
- Experience as a Data Engineer (3 years)
- Hands-on experience with Microsoft Azure data services
- Experience with Microsoft Fabric (Lakehouse pipelines notebooks)
- Strong knowledge of PySpark / Spark SQL
- Experience with Azure Data Factory or Fabric Data Pipelines Azure Data Lake Storage / OneLake
- SQL skills and experience working with large datasets
- Familiarity with Delta Lake / Lakehouse architectures
- Experience with CI/CD and DataOps practices (Azure DevOps or GitHub)
Nice to have
- Experience with Azure Databricks
- Knowledge of Terraform or Bicep
- Experience with Microsoft Purview or data governance tools
- Azure Data certifications (DP-203 DP-600 DP-700)
Additional Information :
The Devoteam Group works for equal opportunities promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.
Remote Work :
No
Employment Type :
Full-time
Design and implement scalable data pipelines and data processing solutions using Azure and Microsoft FabricDevelop and optimize ETL/ELT processes for large-scale datasetsWork with Lakehouse architectures (Medallion Bronze Silver Gold) using Fabric or Azure DatabricksIntegrate data from multiple sou...
- Design and implement scalable data pipelines and data processing solutions using Azure and Microsoft Fabric
- Develop and optimize ETL/ELT processes for large-scale datasets
- Work with Lakehouse architectures (Medallion Bronze Silver Gold) using Fabric or Azure Databricks
- Integrate data from multiple sources using Azure Data Factory / Fabric Data Pipelines
- Build and maintain data models and Lakehouse structures in OneLake
- Ensure data quality reliability and performance across the platform
- Optimize Spark workloads and data transformations using PySpark and SQL
- Collaborate with Data Architects BI teams and Data Scientists to enable analytics and reporting
- Contribute to DataOps practices CI/CD pipelines and automation
- Support data governance and security best practices across the platform
Qualifications :
- Experience as a Data Engineer (3 years)
- Hands-on experience with Microsoft Azure data services
- Experience with Microsoft Fabric (Lakehouse pipelines notebooks)
- Strong knowledge of PySpark / Spark SQL
- Experience with Azure Data Factory or Fabric Data Pipelines Azure Data Lake Storage / OneLake
- SQL skills and experience working with large datasets
- Familiarity with Delta Lake / Lakehouse architectures
- Experience with CI/CD and DataOps practices (Azure DevOps or GitHub)
Nice to have
- Experience with Azure Databricks
- Knowledge of Terraform or Bicep
- Experience with Microsoft Purview or data governance tools
- Azure Data certifications (DP-203 DP-600 DP-700)
Additional Information :
The Devoteam Group works for equal opportunities promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.
Remote Work :
No
Employment Type :
Full-time
View more
View less