Machine Learning Engineer Scene Understanding
Share
Job Location:
Boston, NH - USA
Monthly Salary:
Not Disclosed
Posted on:
13 hours ago
Vacancies:
1 Vacancy
Job Summary
The Perception Scene Understanding team at Zoox builds the high-performance reasoning engines that allow our autonomous vehicles to navigate complex urban environments. We translate sensor data and detected objects into deep semantic understanding ensuring our robots make human-level decisions in real-time.
We are seeking engineers passionate about the intersection of robotics and cutting-edge this role you will develop next-generation algorithms and deploy production-grade software directly to our fleet. You will tackle the inherent unpredictability of urban drivingincluding road closures occlusions dynamic traffic controls and abnormal traffic patternsensuring our vehicles remain resilient in the face of unexpected hazards.
As an engineer on the Scene Understanding team you will develop and deploy advanced machine learning models that interpret the robots surroundings to identify hazards and enforce driving restrictions. Your work will be pivotal in resolving unstructured scenarios ensuring safe navigation through complex or restricted zones. You will optimize models for real-time inference on our vehicle hardware and collaborate closely with teamsincluding Localization Perception Prediction and Planningto deliver a seamless safe and reliable experience for our riders.
In this role you will...
- Develop machine learning algorithms for Birds Eye View scene analysis and real-time hazard detection.
- Design and implement scene understanding solutions specifically for Zooxs unique bidirectional vehicle.
- Lead the end-to-end data strategyincluding mining auto-labeling and dataset constructionto keep our ML models improving.
- Implement on-vehicle software for model inference and result post-processing that runs reliably in real-time.
- Use our large-scale data pipelines and infra to research prototype and deploy changes that directly improve how the vehicle handles complex road scenarios.
- Team up with Perception Prediction and Planning. teams to integrate your signals into the final driving solution.
Qualifications
- BS MS or PhD in Computer Science Robotics or a related field with 2 years of industry experience training and deploying ML models.
- Experience with BEV (Birds Eye View) models segmentation or 3D representations.
- Hands-on experience with the full lifecycle: dataset construction training frameworks and building metrics pipelines to evaluate performance.
- A strong mathematical foundation in linear algebra calculus and probability.
- Fluency in C and Python. Experience with PyTorch TensorFlow JAX.
Bonus Qualifications
- Track record of designing novel neural network architectures or working with probabilistic outputs.
- Experience working on autonomous systems or integrating ML models into a robotics stack.
- Publications in top-tier conferences like CVPR ICCV ECCV RSS or ICRA.
$179000 - $245000 a year
Base Salary Range
There are three major components to compensation for this position: salary Amazon Restricted Stock Units (RSUs) and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling as well as positioning within a level is determined by a range of factors including but not limited to a candidates relevant years of experience domain knowledge and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.
Zoox also offers a comprehensive package of benefits including paid time off (e.g. sick leave vacation bereavement) unpaid time off Zoox Stock Appreciation Rights Amazon RSUs health insurance long-term care insurance long-term and short-term disability insurance and life insurance.
About Zoox
Zoox is developing the first ground-up fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics machine learning and design Zoox aims to provide the next generation of mobility-as-a-service in urban environments. Were looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to emailprotected or your assigned recruiter.
A Final Note:
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
IC
Key Skills
- Industrial Maintenance
- Machining
- Mechanical Knowledge
- CNC
- Precision Measuring Instruments
- Schematics
- Maintenance
- Hydraulics
- Plastics Injection Molding
- Programmable Logic Controllers
- Manufacturing
- Troubleshooting
About Company
We’re reinventing personal transportation—making the future safer, cleaner, and more enjoyable for everyone. This is on-demand autonomous ride-hailing.
