Data Engineer (ID 3674)
Job Summary
As a Data Engineer you will:
- Design develop and maintain scalable data pipelines using Databricks (Python & SQL) and Apache Spark
- Build and manage robust data transformation workflows using dbt
- Orchestrate end-to-end data workflows using Azure Data Factory
- Implement and monitor data quality checks using tools like Soda
- Ensure data governance cataloging and compliance using Microsoft Purview
- Develop and optimize data models for reporting and analytics
- Collaborate with cross-functional teams including data analysts BI developers and stakeholders
- Support reporting solutions using Power BI including DAX-based calculations
- Contribute to CI/CD pipelines and deployment processes using Azure DevOps
What You Bring to the Table:
- 610 years of experience in Data Engineering or related roles
- Strong hands-on experience with Databricks Spark and Python
- Solid expertise in SQL Server and advanced SQL querying
- Experience with dbt for data modeling and transformation
- Proven experience with Azure Data Factory for orchestration
- Knowledge of data quality frameworks and tools like Soda
- Familiarity with data governance tools especially Microsoft Purview
- Experience working in cloud-based data platforms preferably Azure
- Exposure to Power BI and DAX for reporting and analytics
- (Preferred) Experience with SSIS / SSRS
You should possess the ability to:
- Work in a modern industrialized data ecosystem with strong governance standards
- Design efficient and scalable data architectures
- Ensure high data reliability quality and integrity
- Troubleshoot and optimize complex data pipelines
- Communicate effectively with both technical and non-technical stakeholders
- Adapt quickly in a fast-paced agile environment
What we bring to the table:
- Opportunity to work on modern cloud-based data platforms and technologies
- Exposure to enterprise-level data governance and quality frameworks
- A collaborative and innovation-driven work environment
- Opportunities for continuous learning and professional growth
- Challenging projects that drive business impact through data