Sr. Data Engineer- Databricks, Apache Spark
Job Summary
Job Description
Role: Sr. Data Engineer
Work Model: Hybrid 2 days onsite (9:00 AM 5:00 PM)
Role Summary:
Senior Data Engineer (Databricks-Focused)
In-Person Interview is Mandatory Please dont share Virtual Interview Profiles.
We are seeking a Senior Data Engineer with deep expertise in building scalable Lakehouse solutions using Databricks. This role will lead the design of data architecture develop high-performance pipelines and own end-to-end data workflows while mentoring junior engineers.
Key Responsibilities
- Design and implement Lakehouse architectures using Delta Lake.
- Build and optimize batch and streaming pipelines using Apache Spark (PySpark/Scala).
- Own end-to-end data flows: ingestion transformation modeling serving.
- Implement data quality monitoring and CI/CD best practices.
- Optimize cluster performance and cost efficiency within Databricks.
- Provide technical leadership conduct code reviews and mentor junior engineers.
Required Experience
- 8 years in data engineering with strong hands-on experience in Databricks.
- Advanced SQL and data modeling expertise.
- Deep experience with Spark performance tuning and large-scale data processing.
- Strong understanding of cloud platforms (AWS Azure or GCP).
- Proven ability to design and deliver production-grade data platforms.