Principal Tech Lead Manager Embodied AI Evaluation Foundations
Share
Job Location:
Sunnyvale, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
5 days ago
Vacancies:
1 Vacancy
Job Summary
Job Description
About the Team:
TheEvaluation Foundations team is a part of the Scaling Foundations team in Embodied AIandis responsible for
Building the Largest mostDiverseand highest Quality Datasets for model training and evaluation now and into the future
Utilizing our resources in the most Efficient way including storage and compute but especially GPUs
Minimizing the time of iteration and providing the highest quality introspection tools and evaluationsignalto shorten the experimental path towards the best model.
Why Join Us
Scale upintrospection and evaluation tools that work with billions of examples and enableutilizationof our largedatasetsdeliveringthe maximum value to the model through everyadditionalexample.
Work withcutting-edgetechnology and a collaborative high-impact team of AI/ML engineers data scientists and engineers who are passionate aboutleveragingadvanced AI techniques to drive innovation for L2 L3 and L4 applications.
Contribute to the safety reliability and scalability of next-generation autonomous vehicles.
Role:
As a PrincipalEngineerin the Embodied AIScalingFoundations organization you will be a seniortechnical leaderowningthe technical vision and architecture for how wemeasure and visualize AV model performance.
As a full-stack engineer you will focus on the entire lifecycle of designingimplementingscalingand iterating onstate-of-the-arttools that the entire Embodied AI organization andadjacent teams in the GM AV organizationuse. You will level up these foundational tools by
Providinghighquality evaluationsignaland introspection toolsto shorten the experimental path toward the best model.
Owningvisualization and metrics presentationfor our model evaluation loop.
Enabling teams todeeply introspect model behaviorand reach actionable next steps in as few steps as possible.
You willcollaborate closelywithmodeling and data scalingteams working on sourCompound AI drivingmodelsto define how we evaluate them atscalewith model-based metricsend-to-endsimulation andacceleratehowengineers usethat signalandfeed back into data training and launch decisions.
Your work ensures evaluation data and infra form a cohesiveevaluation flywheel: better signal better data and training decisions better models better signal.
What Youll Do:
Own the architecture and roadmapfor evaluation and introspection systems across AV models ensuring consistent metrics pipelines and visualization surfaces.
Partner withthe broaderEmbodied AI teamand integratecore metrics scoring functions and scenario/slice definitionsused for regression launch gating and safety analysisinto evaluation tooling owned by the team.
Build and scaleevaluation pipelineson modern cloud / GPU infrastructure with strong observability and cost efficiency.
Lead development ofvisualization and introspection toolsthat let teams quickly drill from aggregates down to concrete examples failure modes and regressions.
Partner with Data Consumption/Mining/Quality and Infra Foundations toturn evaluation insights into data and training actions(scenario mining dataset definitions training recipes model selection).
Collaborate with simulation and onroad validation teams toalign offline metrics and tools with online behaviorand improve correlation between evaluation and realworld outcomes.
Mentor engineers across Scaling Foundations set best practices for evaluation and introspection and act as adomain expertfor evaluationrelatedtoolingdesigns and reviews.
Your Skills & Abilities:
Familiarityand experience with at least some of the following key technologies
Frontend:React/TypeScript WebGL/WebGPU(for 3D sensor visualization)StreamlitJupyternotebooks
Backend:Python high-throughput data streaming Parquet for efficient data handling.
Data/Infra:Spark for stream processingBigQuery Kubernetes and specialized AV data formats (RosbagsProtobuf).
BachelorsMastersor PhD degree in Computer Scienceor related field
Experienceaccelerating applied research in the wild andmaintainingbest practices while working on tight deadlines.
Proven experience in building largescale systems that areperformantandusedbylargedistributedteams.
Excellent communication skills to effectively collaborate with diverse teams and stakeholders.
Plus:Previousexperience in Robotics or Autonomous Driving.
Compensation: The compensation information is a good faith estimate only. It is based on what a successful applicant might be paidin accordance withapplicable state laws. The compensation may not be representative for positionslocatedoutside of New York Colorado California or Washington.
The salary range for this roleis$296300 to $453900.The actual basesalarya successful candidate will be offered within this range will vary based on factors relevant to the position.
Bonus Potential: An incentivepayprogram offers payouts based on company performance job level and individual performance.
Benefits:
Benefits: GM offers a variety of health and wellbeing benefit programs.Benefit options include medical dental vision Health Savings Account Flexible Spending Accounts retirement savings plan sickness and accident benefits life insurance paid vacation & holidays tuitionassistanceprograms employeeassistanceprogram GM vehicle discounts and more.
Company Vehicle: Upon successful completion of a motor vehicle report review you will be eligible toparticipatein a company vehicle evaluation program through which you will be assigned a General Motors vehicle to drive and evaluate. Note: program participantsare required topurchase/lease a qualifying GM vehicle every four years unless one of a limited number of exceptions applies.
About GM
Our vision is a world with Zero Crashes Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better safer and more equitable for all.
Why Join Us
We believe we all must make a choice every day individually and collectively to drive meaningful change through our words our deeds and our culture. Every day we want every employee to feel they belong to one General Motors team.
Benefits Overview
From day one were looking out for your well-beingat work and at homeso you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.
Non-Discrimination and Equal Employment Opportunities (U.S.)
General Motors is committed to being a workplace that is not only free of unlawful discrimination but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.
All employment decisions are made on a non-discriminatory basis without regard to sex race color national origin citizenship status religion age disability pregnancy or maternity status sexual orientation gender identity status as a veteran or protected veteran or any other similarly protected status in accordance with federal state and local laws.
We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required where applicable to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more visit How we Hire.
Accommodations
General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment email us or call your email please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.
Required Experience:
Manager
About Company
GM is home to Chevrolet, Buick, GMC & Cadillac and has been leading the auto industry for over a century. See how we create a vehicle for every drive.
