Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
At Collective Health were transforming how employers and their people engage with their health benefits by seamlessly integrating cuttingedge technology compassionate service and worldclass user experience design.
We deliver a connected healthcare experience for over 600000 members and 70 companies nationwide who want the best for their employees. Our data engineering team is pivotal in this mission constructing and managing scalable highperformance data pipelines and architectures that drive analytics operational workflows and machine learning applications.
As a Lead Data Engineer you will drive the development of robust scalable and efficient data solutions collaborating closely with crossfunctional teams. You will provide thought leadership on data architecture mentor junior engineers and optimize our data ecosystem for performance and reliability
What youll do:
- Architect Scalable Data Solutions Design develop and optimize largescale data pipelines using Spark (PySpark Scala) Databricks and distributed data processing frameworks.
- Advance Data Modeling & Architecture Lead the design and evolution of data models to support analytical operational and machinelearning requirements.
- Enhance Data Performance & Reliability Improve data processing performance scalability and reliability while ensuring data quality and governance.
- Drive CrossFunctional Collaboration Partner with Product Engineering Data Science and Analytics teams to deliver highimpact data solutions that generate actionable business and clinical insights.
- Mentor & Provide Technical Leadership Guide junior and midlevel engineers conduct code reviews and establish best practices in data engineering.
- Ensure Data Governance & Security Implement robust security privacy and compliance measures for sensitive healthcare data ensuring adherence to industry regulations.
- Influence Data Strategy Provide input on data infrastructure decisions emerging technologies and process improvements.
To be successful in this role youll need:
- 8 years of data engineering experience in fastpaced datadriven environments.
- Expertise in building scalable ETL pipelines with Spark (PySpark or Scala) and SQL.
- Deep understanding of data architecture schema design and dimensional modeling for analytics and machine learning.
- Proficiency in distributed systems such as Spark Databricks or Snowflake.
- Experience with eventdriven architectures and streaming platforms like Kafka or Kinesis.
- Excellent communication skills ability to collaborate crossfunctionally and translate complex technical concepts into business impact.
- Mentorship experience experience guiding engineers and fostering a collaborative inclusive team culture.
- Securityfirst mindset familiarity with data privacy encryption and compliance in healthcare or other regulated industries is a plus.
This is a highly visible role within the organization where your contributions will shape the future of our data ecosystem and drive impactful healthcare insights. If youre passionate about solving complex data challenges while making a realworld difference wed love to hear from you!
Pay Transparency Statement
This is a hybrid position based out of one of our offices with the expectation of being in office at least two weekdays per week. #LIhybrid
The actual pay rate offered within the range will depend on factors including geographic location qualifications experience and internal equity. In addition to the salary you will be eligible for stock options and benefits like health insurance 401k and paid time off. Learn more about our benefits at Francisco CA Pay Range
Why Join Us
- Missiondriven culture that values innovation collaboration and a commitment to excellence in healthcare
- Impactful projects that shape the future of our organization
- Opportunities for professional development through internal mobility opportunities mentorship programs and courses tailored to your interests
- Flexible work arrangements and a supportive worklife balance
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race religion color national origin gender sexual orientation age marital status veteran status or disability status. Collective Health is committed to providing support to candidates who require reasonable accommodation during the interview process. If you need assistance please contact .
Privacy Notice
For more information about why we need your data and how we use it please see our privacy policy: https://collectivehealth/privacypolicy/.
Employment Type
Full Time
