Job description
Job Title: Azure Synapse Data Engineer
Location: Chennai /Onsite
Experience: 3 years
Employment Type: Full-time
Job Summary:
We are looking for a skilled Azure Synapse Data Engineer to join our digital solutions team. The ideal candidate will have experience in designing and building scalable production-grade data pipelines using Azure Synapse Analytics or Azure Data Factory. You will work on large-scale data ingestion transformation and integration projects across a diverse range of file formats and ensure efficient metadata and governance practices using Azure Purview.
Key Responsibilities:
- Develop test and maintain data ingestion and transformation pipelines using Azure Synapse or Azure Data Factory.
- Create scalable and robust data solutions capable of handling 1000 different file formats.
- Design and implement enterprise-grade logging error handling and monitoring within data pipelines.
- Develop parameterized pipelines and optimized data structures for performance and maintainability.
- Establish and manage CI/CD pipelines and promote code across Dev Test Prod environments.
- Collaborate closely with cross-functional teams to ensure knowledge transfer and adoption of best practices.
- Implement effective metadata strategies and leverage Azure Purview for data cataloging and lineage.
- Write clean efficient and testable code following software development best practices.
- Deliver assigned tasks within scope timelines and quality standards.
Required Qualifications:
- Bachelors or Masters degree in Computer Science IT Electronics or a related field.
- Minimum 3 years of hands-on experience with Azure Synapse Analytics or Azure Data Factory.
- Strong experience in building and deploying data pipelines in cloud environments.
- Hands-on experience with CI/CD tools and pipelines (Azure DevOps preferred).
- Proficiency in SQL and working with large-scale datasets.
- Experience working with Azure Purview or similar metadata governance tools.
- Strong communication collaboration and documentation skills.
Preferred Skills:
- Experience in power systems or industrial data environments is a plus.
- Understanding of Agile methodologies and DevOps practices.
- Exposure to data warehousing ETL best practices and data lake architecture.
What We Offer:
- Opportunity to work with a global R&D team on innovative digital energy solutions.
- Inclusive and collaborative work culture.
- Continuous learning and development opportunities.
Thanks and Regards
Archana patil
Assistant Manager - TAPh#