We are looking for experienced Azure Databricks Data Engineer / Data Architect to design build and optimize scalable data platforms in a modern cloud environment. This role involves hands-on development of ETL/ELT pipelines data quality automation cloud migration and implementation of governance frameworks supporting analytics BI and ML use cases.
Key Responsibilities
- Architect design and implement scalable data solutions on Azure and Databricks.
- Build automate and orchestrate robust ETL/ELT pipelines using CI/CD best practices.
- Ensure data quality through automated unit integration and validation testing.
- Manage data ingestion and integration from on-premise systems to cloud environments.
- Implement and maintain Data Governance frameworks using Azure Purview and Unity Catalog.
- Optimize cloud data architectures for performance security and cost efficiency.
- Collaborate with analytics BI and ML teams to ensure high-quality data availability.
- Monitor and maintain data platform reliability scalability and compliance.
Qualifications :
- Strong proficiency in Python and Apache Spark for large-scale distributed data processing.
- Solid experience with SQL and NoSQL databases including data modeling and query optimization.
- Hands-on experience designing workflows using data pipeline orchestration tools (e.g. ADF Airflow Databricks Workflows).
- Experience with cloud-native data platforms ideally in Azure.
- Familiarity with Infrastructure as Code (IaC) tools such as Terraform or ARM templates.
- Understanding of data quality frameworks testing methodologies and CI/CD pipelines.
- Exposure to Business Intelligence (BI) and Machine Learning (ML) scenarios ensuring data readiness for advanced analytics.
- Strong analytical problem-solving and communication skills.
Nice to Have
- Experience with Microsoft Azure ecosystem (Azure Data Factory Synapse Azure Storage Azure Functions).
- Hands-on experience with Databricks (Delta Lake Unity Catalog Workflows Optimizations).
- Relevant certifications (e.g. Azure Data Engineer Databricks Data Engineer Associate/Professional).
Additional Information :
We offer:
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package including health insurance and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset: reap the benefits of a range of professional development opportunities including certification programs mentorship and talent investment programs internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars including IT education community empowerment fair operating practices environmental sustainability and gender equality.
* Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race color religion sex national origin age disability veteran status sexual orientation gender identity or any other protected status under applicable law.
Remote Work :
Yes
Employment Type :
Full-time
We are looking for experienced Azure Databricks Data Engineer / Data Architect to design build and optimize scalable data platforms in a modern cloud environment. This role involves hands-on development of ETL/ELT pipelines data quality automation cloud migration and implementation of governance fra...
We are looking for experienced Azure Databricks Data Engineer / Data Architect to design build and optimize scalable data platforms in a modern cloud environment. This role involves hands-on development of ETL/ELT pipelines data quality automation cloud migration and implementation of governance frameworks supporting analytics BI and ML use cases.
Key Responsibilities
- Architect design and implement scalable data solutions on Azure and Databricks.
- Build automate and orchestrate robust ETL/ELT pipelines using CI/CD best practices.
- Ensure data quality through automated unit integration and validation testing.
- Manage data ingestion and integration from on-premise systems to cloud environments.
- Implement and maintain Data Governance frameworks using Azure Purview and Unity Catalog.
- Optimize cloud data architectures for performance security and cost efficiency.
- Collaborate with analytics BI and ML teams to ensure high-quality data availability.
- Monitor and maintain data platform reliability scalability and compliance.
Qualifications :
- Strong proficiency in Python and Apache Spark for large-scale distributed data processing.
- Solid experience with SQL and NoSQL databases including data modeling and query optimization.
- Hands-on experience designing workflows using data pipeline orchestration tools (e.g. ADF Airflow Databricks Workflows).
- Experience with cloud-native data platforms ideally in Azure.
- Familiarity with Infrastructure as Code (IaC) tools such as Terraform or ARM templates.
- Understanding of data quality frameworks testing methodologies and CI/CD pipelines.
- Exposure to Business Intelligence (BI) and Machine Learning (ML) scenarios ensuring data readiness for advanced analytics.
- Strong analytical problem-solving and communication skills.
Nice to Have
- Experience with Microsoft Azure ecosystem (Azure Data Factory Synapse Azure Storage Azure Functions).
- Hands-on experience with Databricks (Delta Lake Unity Catalog Workflows Optimizations).
- Relevant certifications (e.g. Azure Data Engineer Databricks Data Engineer Associate/Professional).
Additional Information :
We offer:
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package including health insurance and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset: reap the benefits of a range of professional development opportunities including certification programs mentorship and talent investment programs internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars including IT education community empowerment fair operating practices environmental sustainability and gender equality.
* Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race color religion sex national origin age disability veteran status sexual orientation gender identity or any other protected status under applicable law.
Remote Work :
Yes
Employment Type :
Full-time
View more
View less