Job Title: Data Engineer
Experience: 3 -5 Years
Primary Mandate Skills:
Key responsibilities:
- Design develop and maintain data pipelines and ETL processes using Microsoft Azure services (e.g. Azure Data Factory Azure Synapse Azure Databricks Azure Fabric).
- Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g. Azure Data Lake Storage Gen 2 & Azure Blob storage).
- Collaborate with data scientists data analysts data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize data pipelines in the Azure environment for performance scalability and reliability.
- Ensure data quality and integrity through data validation techniques and frameworks.
- Develop and maintain documentation for data processes configurations and best practices.
- Monitor and troubleshoot data pipeline issues to ensure timely resolution.
- Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
- Manage the CI/CD process for deploying and maintaining data solutions.
Explore more on the opportunity
Contact: /
Azure Data Factory,Microsoft Azure services