Senior Azure Data Engineer
Share
Job Location:
Monthly Salary:
Experience Required:
Posted on:
23 hours ago
Vacancies:
1 Vacancy
Job Summary
- Design develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation workflows using Azure Databricks (PySpark) and Python.
- Develop and fine-tune SQL queries stored procedures and views for high-volume data platforms.
- Implement data quality frameworks monitoring and logging mechanisms across data pipelines.
- Establish and manage CI/CD pipelines for data solutions using Azure DevOps.
- Handle deployment automation for ADF pipelines Databricks notebooks and database scripts.
- Manage version control branching strategies and environment configuration across development lifecycles.
- Deploy and maintain Azure infrastructure components such as Azure SQL Event Grid Virtual Networks (VNet) Private Endpoints (PEP) Key Vaults and related services using Bicep.
- Ensure adherence to security governance and compliance standards across data platforms.
- 68 years of overall experience in Data Engineering or related roles.
- Strong hands-on expertise in Azure Data Factory Azure Databricks and PySpark.
- Proficiency in Python programming for data processing and automation.
- Advanced knowledge of SQL performance tuning and data modeling.
- Experience implementing DevOps practices in data engineering environments using Azure DevOps.
- Solid understanding of Azure cloud infrastructure and Infrastructure as Code using Bicep.
- Experience working with enterprise-scale data ingestion transformation and orchestration.
- Familiarity with data governance security best practices and compliance frameworks.
- Design and implement high-performance scalable and reliable data pipelines.
- Troubleshoot optimize and enhance data workflows for performance and cost efficiency.
- Collaborate with cross-functional teams including analytics application development and infrastructure teams.
- Automate deployments and enforce best practices for code versioning and release management.
- Translate business and technical requirements into robust data engineering solutions.
- Ensure strong documentation monitoring and operational support for data platforms.
- Opportunities to work on large-scale cloud-based data transformation initiatives.
- Exposure to modern Azure data and analytics ecosystem.
- A collaborative environment focused on innovation automation and continuous improvement.
- Opportunities to contribute to architecture design and next-generation data platform development.
- A learning-driven culture encouraging adoption of emerging cloud and data engineering technologies.
As a Senior Azure Data Engineer you will: Design develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory (ADF). Build and optimize data transformation workflows using Azure Databricks (PySpark) and Python. Develop and fine-tune SQL queries stored procedures and views for high-volume data platforms. Implement data quality frameworks monitoring and logging mechanisms across data pipelines. Establish and manage CI/CD pipelines for data solutions using Azure DevOps. Handle deployment automation for ADF pipelines Databricks notebooks and database scripts. Manage version control branching strategies and environment configuration across development lifecycles. Deploy and maintain Azure infrastructure components such as Azure SQL Event Grid Virtual Networks (VNet) Private Endpoints (PEP) Key Vaults and related services using Bicep. Ensure adherence to security governance and compliance standards across data platforms. What You Bring to the Table: 68 years of overall experience in Data Engineering or related roles. Strong hands-on expertise in Azure Data Factory Azure Databricks and PySpark. Proficiency in Python programming for data processing and automation. Advanced knowledge of SQL performance tuning and data modeling. Experience implementing DevOps practices in data engineering environments using Azure DevOps. Solid understanding of Azure cloud infrastructure and Infrastructure as Code using Bicep. Experience working with enterprise-scale data ingestion transformation and orchestration. Familiarity with data governance security best practices and compliance frameworks. You Should Possess the Ability To: Design and implement high-performance scalable and reliable data pipelines. Troubleshoot optimize and enhance data workflows for performance and cost efficiency. Collaborate with cross-functional teams including analytics application development and infrastructure teams. Automate deployments and enforce best practices for code versioning and release management. Translate business and technical requirements into robust data engineering solutions. Ensure strong documentation monitoring and operational support for data platforms. What We Bring to the Table: Opportunities to work on large-scale cloud-based data transformation initiatives. Exposure to modern Azure data and analytics ecosystem. A collaborative environment focused on innovation automation and continuous improvement. Opportunities to contribute to architecture design and next-generation data platform development. A learning-driven culture encouraging adoption of emerging cloud and data engineering technologies. Lets Connect Want to discuss this opportunity in more detail Feel free to reach out. Recruiter: Aswin Dhanvandhar Phone:; Extn :141 Email: LinkedIn:
Company Industry
IT Services and IT Consulting
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
