Senior Databricks Developer
Share
Job Location:
Los Angeles, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
Position Title: Senior Databricks Developer
Location: Los Angeles CA (Local Candidates Only Hybrid 1 Day On-site per week)
Duration: Contract
Client: News company
Location: Los Angeles CA (Local Candidates Only Hybrid 1 Day On-site per week)
Duration: Contract
Client: News company
Position Overview
Fox is seeking a highly skilled and experienced Senior Databricks Developer to join our data engineering team in Los Angeles. This role is strictly open to local Los Angeles candidates operating on a hybrid schedule that requires one day of on-site collaboration per week at our LA office.
In this role you will design develop and optimize robust data pipelines and analytics solutions using the Databricks Lakehouse platform. You will play a critical role in handling large-scale media and entertainment data ensuring high performance scalability and reliability to drive data-driven decision-making across the organization.
Key Responsibilities
Pipeline Development: Design build and maintain scalable automated and secure Delta Lake pipelines using Databricks (PySpark Spark SQL Scala).
Architecture & Optimization: Optimize complex Spark jobs for performance memory management and cost efficiency. Implement best practices for Lakehouse architecture.
Data Integration: Extract transform and load (ETL/ELT) data from structured semi-structured and unstructured sources (e.g. streaming data API feeds cloud storage).
Fox is seeking a highly skilled and experienced Senior Databricks Developer to join our data engineering team in Los Angeles. This role is strictly open to local Los Angeles candidates operating on a hybrid schedule that requires one day of on-site collaboration per week at our LA office.
In this role you will design develop and optimize robust data pipelines and analytics solutions using the Databricks Lakehouse platform. You will play a critical role in handling large-scale media and entertainment data ensuring high performance scalability and reliability to drive data-driven decision-making across the organization.
Key Responsibilities
Pipeline Development: Design build and maintain scalable automated and secure Delta Lake pipelines using Databricks (PySpark Spark SQL Scala).
Architecture & Optimization: Optimize complex Spark jobs for performance memory management and cost efficiency. Implement best practices for Lakehouse architecture.
Data Integration: Extract transform and load (ETL/ELT) data from structured semi-structured and unstructured sources (e.g. streaming data API feeds cloud storage).
Collaboration: Partner with data scientists business analysts and stakeholders to understand data requirements. Participate in weekly in-person team alignment and collaboration sessions at the LA office.
Governance & Security: Implement data governance unity catalog access controls and data quality checks within the Databricks environment.
CI/CD & DevOps: Set up and maintain CI/CD pipelines for data workflows using tools like Git Azure DevOps or AWS Developer tools.
Governance & Security: Implement data governance unity catalog access controls and data quality checks within the Databricks environment.
CI/CD & DevOps: Set up and maintain CI/CD pipelines for data workflows using tools like Git Azure DevOps or AWS Developer tools.
Required Skills & Qualifications
Location: Must currently reside in the Greater Los Angeles area (No relocation or remote candidates from other states will be considered).
Experience: 7 years of total experience in Data Engineering with 3 years of dedicated hands-on experience with Databricks.
Core Technical Skills:
Proficient in PySpark Spark SQL or Scala/Java.
Strong mastery of the Databricks Delta Lake architecture.
Expert-level SQL skills for complex data analysis and transformation.
Cloud Platform: Strong experience working with Databricks on cloud infrastructure (AWS or Azure preferred).
Communication: Excellent communication skills with the ability to articulate technical concepts clearly during face-to-face and remote meetings.
Location: Must currently reside in the Greater Los Angeles area (No relocation or remote candidates from other states will be considered).
Experience: 7 years of total experience in Data Engineering with 3 years of dedicated hands-on experience with Databricks.
Core Technical Skills:
Proficient in PySpark Spark SQL or Scala/Java.
Strong mastery of the Databricks Delta Lake architecture.
Expert-level SQL skills for complex data analysis and transformation.
Cloud Platform: Strong experience working with Databricks on cloud infrastructure (AWS or Azure preferred).
Communication: Excellent communication skills with the ability to articulate technical concepts clearly during face-to-face and remote meetings.
Preferred Qualifications
Databricks Certified Data Engineer Professional.
Experience working within the Media & Entertainment industry.
Familiarity with streaming technologies (e.g. Structured Streaming Kafka).
Databricks Certified Data Engineer Professional.
Experience working within the Media & Entertainment industry.
Familiarity with streaming technologies (e.g. Structured Streaming Kafka).
