Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Job Title: Lead Data Engineer
Job Location: San Francisco CA
Job Duration: Longterm Contract
Interview: Virtual
Job Summary:
We are seeking a highly skilled and handson Lead Data Engineer with 8 10 years of experience in designing and developing largescale data processing systems. This role requires deep expertise in Python Spark and Databricks along with strong architectural understanding and the ability to work across both batch and realtime data pipelines.
Key Skills & Experience:
- 5 years of experience in Python and Apache Spark
- Proven track record in building ETL workflows and data pipelines for largescale systems
- Solid experience in data lake data warehouse and big data environments
- Strong understanding of data quality feature extraction and ML model deployment
- Proficient in Databricks Kafka SQL/NoSQL and Java with Spring Boot
- Exposure to deep learning frameworks (TensorFlow PyTorch Keras) and LLMs/Transformers
- Familiar with Redis Delta Lake and Jupyter Notebooks
Preferred Traits:
- Strong problemsolving and architectural skills
- Ability to innovate and adapt to evolving technologies
- Selfdriven with a passion for learning and delivering impactful data solutions
Employment Type
Full Time
