We are looking for a Senior Data Engineer to join our team and drive the design implementation and optimization of data pipelines. The ideal candidate will have expertise in Azure Fabric and Business Intelligence.
Key Responsibilities:
- Lead and mentor junior data engineers while driving QA initiatives.
- Develop endtoend data pipelines from source to end consumers.
- Implement source integration data ingestion transformation and data modeling.
- Design and develop Power BI dashboards for business intelligence insights.
- Contribute to data platform enhancements including CI/CD infrastructure as code and networking.
- Work with Azure technologies to maintain and improve the data platform.
- Collaborate with crossfunctional teams to ensure seamless data flow and optimal performance.
Qualifications :
- 5 years of experience in data engineering with strong expertise in Azure Databricks.
- Proficiency in Python and PySpark for data processing and automation.
- Strong knowledge of SQL for data modeling and source system analysis.
- Handson experience with Azure services including Azure Data Factory Data Lake and SQLbased solutions.
- Familiarity with Fabric and Business Intelligence tools like Power BI.
- Experience in data profiling cataloging and technical data flow design.
- Exposure to eventbased streaming technologies (Kafka Event Hubs) is a plus.
- Experience working in cloudbased data platforms and implementing best practices in data governance and security.
Additional Information :
- 5 years of experience in data engineering with expertise in Azure Databricks.
- Previous experience with Azure (Databricks Fabric and related services)
- Strong expertise in visualization and reporting using PowerBI
- Strong knowledge of ETL processes data modelling and transformation
- Handson experience with CI/CD infrastructure as code and cloud networking
Remote Work :
Yes
Employment Type :
Fulltime