Azure Data Engineer

Hyderabad - India

Monthly Salary: Not Disclosed

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

Seeking a highly skilled and experienced Senior Azure Data Engineer to join our data engineering team. The ideal candidate will have deep expertise in Azure Data Factory (ADF) ETL design and development and SQL with strong development experience in Python and familiarity with CI/CD pipelines. Experience with Informatica PowerCenter and other Azure services is a plus.

Roles & Responsibilities:

Design develop and maintain scalable ETL pipelines using Azure Data Factory (ADF).
Architect and implement data integration solutions using Azure services such as Storage Accounts Functions Logic Apps VMs and Key Vault.
Develop robust and optimized SQL queries and stored procedures for data transformation and reporting.
Build and maintain Python-based data processing scripts for advanced ETL logic and automation.
Implement CI/CD pipelines using Azure DevOps (ADO) and/or Git for automated deployment and version control.
Design and develop shell scripts for automation and orchestration tasks.
Handle large-scale data files and implement change data capture (CDC) and delta processing strategies.
Schedule and monitor jobs using Azure-native or third-party scheduling tools.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Must be a strong team player and promote team collaboration / activities in the team

Be an active participant and a positive player in all initiatives or tasks.
Collaborate with team(s) and with leadership on project status updates risks gaps or feedback on all initiatives or tasks.

Required Skills:

Combined minimum of 5 years higher education and/or operational/business analytics experience
3 years of experience working on Azure Data SQL and ETL technologies
ETL Design & Development: Strong experience in building and optimizing ETL pipelines.
Azure Data Factory (ADF): Expert-level proficiency.
Python: Strong development experience in scripting and automation.
SQL: Expert-level skills in query design performance tuning and data modeling.
CI/CD: Strong experience with Azure DevOps and Git-based deployment workflows.
Shell Scripting: Good understanding and practical experience.
Azure Services: Hands-on experience with Storage Functions Logic Apps VMs Key Vault.
Data Processing: Experience with large files and delta/change data processing.
Should have working experience and good understanding of Agile and SCRUM methodologies
Should be able to document present and share design / solution options. technical artifacts to the team
Excellent communication and collaboration abilities.
Strong analytical and problem-solving skills.
Proactive Results-driven and Detail-oriented.
Ability to multitask for various components of moderately complex to complex projects.
Excellent problem-solving skills to assist in issue resolution and general queries.

Roles & Responsibilities:

Design develop and maintain scalable ETL pipelines using Azure Data Factory (ADF).
Architect and implement data integration solutions using Azure services such as Storage Accounts Functions Logic Apps VMs and Key Vault.
Develop robust and optimized SQL queries and stored procedures for data transformation and reporting.
Build and maintain Python-based data processing scripts for advanced ETL logic and automation.
Implement CI/CD pipelines using Azure DevOps (ADO) and/or Git for automated deployment and version control.
Design and develop shell scripts for automation and orchestration tasks.
Handle large-scale data files and implement change data capture (CDC) and delta processing strategies.
Schedule and monitor jobs using Azure-native or third-party scheduling tools.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Must be a strong team player and promote team collaboration / activities in the team

Be an active participant and a positive player in all initiatives or tasks.
Collaborate with team(s) and with leadership on project status updates risks gaps or feedback on all initiatives or tasks.

Required Skills:

Combined minimum of 5 years higher education and/or operational/business analytics experience
3 years of experience working on Azure Data SQL and ETL technologies
ETL Design & Development: Strong experience in building and optimizing ETL pipelines.
Azure Data Factory (ADF): Expert-level proficiency.
Python: Strong development experience in scripting and automation.
SQL: Expert-level skills in query design performance tuning and data modeling.
CI/CD: Strong experience with Azure DevOps and Git-based deployment workflows.
Shell Scripting: Good understanding and practical experience.
Azure Services: Hands-on experience with Storage Functions Logic Apps VMs Key Vault.
Data Processing: Experience with large files and delta/change data processing.
Should have working experience and good understanding of Agile and SCRUM methodologies
Should be able to document present and share design / solution options. technical artifacts to the team
Excellent communication and collaboration abilities.
Strong analytical and problem-solving skills.
Proactive Results-driven and Detail-oriented.
Ability to multitask for various components of moderately complex to complex projects.
Excellent problem-solving skills to assist in issue resolution and general queries.