Senior Technical Specialist Databricks
Job Location:
Monthly Salary:
Posted on:
6 days ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Description
Title: Senior Azure Databricks Consultant
Location: Hyderabad/Mumbai/Bangalore
Education: Bachelors Degree
Exp Level: 8 Years
Job Description:
- Design and build conformed dimensions and transactional fact tables for enterprise reporting.
- Develop and maintain data pipelines on Azure Databricks using PySpark Spark SQL and Delta Lake.
- Implement best practices in dimensional modeling including:
- Star schemas
- Conformed dimensions
- Surrogate and deterministic hash keys (e.g. SHA-256)
- Transactional fact design
- Translate existing SQL Server and stored procedure logic into efficient Spark-based transformations.
- Implement incremental data processing and change data capture (CDC) pipelines.
- Ensure data reconciliation with source systems to meet accuracy and audit standards.
- Collaborate closely with a senior Databricks lead to deliver core data assets within defined timelines.
Required Experience:
Senior IC
About Company
Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leadi ... View more
