Azure Data Engineer
Azure Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Title: Azure Data Engineer
Work timing 2PM 11PM IST
Role Permanent
Resources HYD as first preference also pan india.
Azure Data Lake Data Factory and Synapse are allcomponents and services offered by Microsoft Azure for managing and processingdata in a cloudbased environment. Heres an overview of each of these components:
Azure is the overarching cloud platform that provides theinfrastructure and services for running applications and managing data in thecloud.
Azure Data Lake is a storage service that allows you to store and manage largevolumes of structured and unstructured data.
Azure Data Factory is a data integration service for creating and managing datapipelines to move transform and process data.
Azure Synapse Analytics is a powerful analytics service that can handle both datawarehousing and big data analytics providing a comprehensive solution for dataprocessing and analysis in the cloud.
JobDescription:
We are seeking a highly skilledAzure Data Engineer to join our team. The ideal candidate should have a strongbackground in Microsoft Azure and expertise in Azure Data Lake Azure DataFactory and Azure Synapse Analytics. As a member of our data engineering teamyou will play a key role in designing implementing and optimizing datasolutions in a cloud environment.
Key Responsibilities:
- Data Integration: Design develop and maintain data pipelines using Azure Data Factory to extract transform and load data from various sources into Azure Data Lake and Azure Synapse Analytics.
- Data Lake Management: Manage and optimize Azure Data Lake Storage Gen2 ensuring data is organized secure and accessible for data processing and analytics.
- Data Warehousing: Build and manage data warehouses using Azure Synapse Analytics to support data analytics and reporting needs.
- Data Transformation: Create data transformation processes including data cleansing enrichment and aggregation to support analytics and reporting requirements.
- Performance Optimization: Optimize data pipelines data lake and data warehouse for improved performance scalability and costefficiency.
- Data Security: Implement data security measures to protect sensitive data and ensure compliance with data governance policies.
- Monitoring and Troubleshooting: Monitor data pipelines and systems identify and resolve data processing issues and perform root cause analysis.
- Documentation: Maintain clear and comprehensive documentation of data engineering processes and solutions.
- Collaboration: Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Azure Best Practices: Stay updated on Azure best practices and trends in data engineering to ensure our solutions are leveraging the latest cloud capabilities.
Requirements
Qualifications:
- Bachelors or Masters degree in Computer Science Information Technology or a related field.
- Proven experience in data engineering with a focus on Azure technologies.
- Strong proficiency in Azure Data Lake Storage Azure Data Factory and Azure Synapse Analytics.
- Proficiency in SQL TSQL and query optimization.
- Experience with data integration ETL processes and data warehousing.
- Knowledge of data security and compliance best practices in a cloud environment.
- Strong problemsolving and troubleshooting skills.
- Excellent communication and teamwork skills.
- Azure certifications (e.g. Azure Data Engineer Azure Solutions Architect) are a plus.
PreferredSkills:
- Experience with other Azure services such as Azure Databricks Azure Stream Analytics and Azure Functions.
- Programming skills in languages like Python or C#.
- Knowledge of data modeling and data architecture.
- Experience with DevOps and CI/CD practices in data engineering.
Employment Type
Full-Time
