Lead Data Engineer (Databricks)
Share
Job Location:
Los Angeles, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
5 hours ago
Vacancies:
1 Vacancy
Job Summary
Location: Los Angeles CA (Hybrid 3 Days Onsite)
Type: Full-Time
Experience: 9 14 Years
We are seeking a Lead Data Engineer with strong expertise in Databricks PySpark and scalable data engineering to support large-scale media and streaming data environments. The role involves building high-performance ETL/ELT pipelines optimizing data infrastructure and supporting analytics and reporting initiatives.
Must-Have Skills- 9 years of experience in Data Engineering
- Strong hands-on experience with Databricks
- Expertise in SQL Python and PySpark
- Strong experience in ETL / ELT pipeline development
- Experience with Data Modeling & Data Warehousing
- Experience building Lakehouse architectures
- Hands-on experience with Airflow or workflow orchestration tools
- Strong understanding of performance optimization and monitoring
- Experience with AWS cloud platforms
- Excellent communication and stakeholder management skills
- Design build and maintain scalable ETL/ELT pipelines
- Develop and optimize data models lakehouse and warehouse solutions
- Build high-volume batch and near real-time data pipelines
- Monitor troubleshoot and optimize production workloads
- Implement orchestration and workflow automation solutions
- Collaborate with analytics reporting and engineering teams
- Lead technical discussions and mentor engineering teams
- Support scalable solutions for streaming and subscription datasets
- Experience in Media / Streaming / Subscription platforms
- Experience handling high-volume consumer datasets
- Exposure to real-time data processing environments
