Azure Data Engineer (ADF, Databricks, PySpark)
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
Job Title: Azure Data Engineer (ADF Databricks PySpark)
Duration: 12 Months
Work Model: Hybrid (2 days/week onsite)
Experience: 46 Years
Required Skills
- Strong hands-on experience with Azure Data Factory (ADF) Azure Databricks (ADB) PySpark and SQL.
- Experience designing developing and maintaining ETL frameworks and data pipelines.
- Expertise in building scalable and efficient data integration solutions.
- Strong SQL querying and performance optimization skills.
Preferred Skills
- 35 years of Data Analysis experience.
- Knowledge of Azure Big Data technologies data mapping reporting and data warehousing concepts.
- Experience with MySQL SQL Developer TOAD Jira and Confluence.
- Familiarity with data encryption logging monitoring and security tools.
Key Responsibilities
- Design develop and support ETL frameworks and enterprise data pipelines.
- Build and optimize data solutions using ADF Databricks PySpark and SQL.
- Perform data mapping transformation validation and reporting activities.
- Ensure data quality security scalability and performance across platforms.
- Collaborate with business and technical teams to deliver data-driven solutions.
- Support Agile delivery processes using Jira and Confluence.
- Monitor data workflows troubleshoot issues and implement improvements.
Keywords: Azure Data Factory Azure Databricks PySpark SQL ETL Data Engineering Azure Big Data Data Warehousing Data Mapping MySQL TOAD SQL Developer Jira Confluence.