We are looking for experienced Azure Databricks Data Engineer / Data Architect to design build and optimize scalable data platforms in a modern cloud environment. This role involves hands-on development of ETL/ELT pipelines data quality automation cloud migration and implementation of governance frameworks supporting analytics BI and ML use cases.
Key Responsibilities
- Architect design and implement scalable data solutions on Azure and Databricks.
- Build automate and orchestrate robust ETL/ELT pipelines using CI/CD best practices.
- Ensure data quality through automated unit integration and validation testing.
- Manage data ingestion and integration from on-premise systems to cloud environments.
- Implement and maintain Data Governance frameworks using Azure Purview and Unity Catalog.
- Optimize cloud data architectures for performance security and cost efficiency.
- Collaborate with analytics BI and ML teams to ensure high-quality data availability.
- Monitor and maintain data platform reliability scalability and compliance.
Qualifications :
- Strong proficiency in Python and Apache Spark for large-scale distributed data processing.
- Solid experience with SQL and NoSQL databases including data modeling and query optimization.
- Hands-on experience designing workflows using data pipeline orchestration tools (e.g. ADF Airflow Databricks Workflows).
- Experience with cloud-native data platforms ideally in Azure.
- Familiarity with Infrastructure as Code (IaC) tools such as Terraform or ARM templates.
- Understanding of data quality frameworks testing methodologies and CI/CD pipelines.
- Exposure to Business Intelligence (BI) and Machine Learning (ML) scenarios ensuring data readiness for advanced analytics.
- Strong analytical problem-solving and communication skills.
Nice to Have
- Experience with Microsoft Azure ecosystem (Azure Data Factory Synapse Azure Storage Azure Functions).
- Hands-on experience with Databricks (Delta Lake Unity Catalog Workflows Optimizations).
- Relevant certifications (e.g. Azure Data Engineer Databricks Data Engineer Associate/Professional).
Additional Information :
We offer:
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package including health insurance and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset: reap the benefits of a range of professional development opportunities including certification programs mentorship and talent investment programs internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars including IT education community empowerment fair operating practices environmental sustainability and gender equality.
Remote Work :
Yes
Employment Type :
Full-time
We are looking for experienced Azure Databricks Data Engineer / Data Architect to design build and optimize scalable data platforms in a modern cloud environment. This role involves hands-on development of ETL/ELT pipelines data quality automation cloud migration and implementation of governance fra...
We are looking for experienced Azure Databricks Data Engineer / Data Architect to design build and optimize scalable data platforms in a modern cloud environment. This role involves hands-on development of ETL/ELT pipelines data quality automation cloud migration and implementation of governance frameworks supporting analytics BI and ML use cases.
Key Responsibilities
- Architect design and implement scalable data solutions on Azure and Databricks.
- Build automate and orchestrate robust ETL/ELT pipelines using CI/CD best practices.
- Ensure data quality through automated unit integration and validation testing.
- Manage data ingestion and integration from on-premise systems to cloud environments.
- Implement and maintain Data Governance frameworks using Azure Purview and Unity Catalog.
- Optimize cloud data architectures for performance security and cost efficiency.
- Collaborate with analytics BI and ML teams to ensure high-quality data availability.
- Monitor and maintain data platform reliability scalability and compliance.
Qualifications :
- Strong proficiency in Python and Apache Spark for large-scale distributed data processing.
- Solid experience with SQL and NoSQL databases including data modeling and query optimization.
- Hands-on experience designing workflows using data pipeline orchestration tools (e.g. ADF Airflow Databricks Workflows).
- Experience with cloud-native data platforms ideally in Azure.
- Familiarity with Infrastructure as Code (IaC) tools such as Terraform or ARM templates.
- Understanding of data quality frameworks testing methodologies and CI/CD pipelines.
- Exposure to Business Intelligence (BI) and Machine Learning (ML) scenarios ensuring data readiness for advanced analytics.
- Strong analytical problem-solving and communication skills.
Nice to Have
- Experience with Microsoft Azure ecosystem (Azure Data Factory Synapse Azure Storage Azure Functions).
- Hands-on experience with Databricks (Delta Lake Unity Catalog Workflows Optimizations).
- Relevant certifications (e.g. Azure Data Engineer Databricks Data Engineer Associate/Professional).
Additional Information :
We offer:
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package including health insurance and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset: reap the benefits of a range of professional development opportunities including certification programs mentorship and talent investment programs internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars including IT education community empowerment fair operating practices environmental sustainability and gender equality.
Remote Work :
Yes
Employment Type :
Full-time
View more
View less