Senior Databricks Data Engineer
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Role : Senior Databricks Data Engineer
Company Name : WillWare Technologies
Experience : 6 to 8 Years
Work Model : Hybrid / Fulltime
Work Location : Pune
Role Summary:
Lead engineer drivingperformance tuning cost optimization strategies and enforcing best practices across Databricks workloads.
Key Responsibilities:
- Analyze and optimize existing workloads forcost and performance
- Design efficient data models and scalable pipelines
- Implement advanced Spark optimization techniques (shuffle tuning caching strategies)
- Optimize cluster utilization (instance types spot usage auto-termination)
- Establishcoding standards and reusable frameworks
- Mentor junior engineers and conduct code reviews
Required Skills:
- Strong Databricks Spark expertise (deep performance tuning experience)
- Advanced Delta Lake optimization techniques
- Cost optimization strategies in cloud data platforms
- Strong debugging and profiling skills
Required Skills:
SparkDatabricksDelta Lake