Senior Software Engineer, AI Infrastructure LVM Inference & Evaluation

Build a safer world with us one incident at a time.

is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar the first reasoning Vision-Language Model purpose-built for physical security our platform seamlessly integrates with existing security cameras and physical access control systems to unify monitoring access control threat assessment response and investigations through an always-on reasoning layer that augments security operators with superhuman capabilities. The results: 95% fewer false alarms investigations 20x faster and 10x faster response.

The momentum speaks for itself: we doubled new ARR in FY26 and have delivered results for world-class customers including Cisco ServiceNow SentinelOne TikTok Bayer and MoMA. That kind of momentum creates an environment where great people thrive and it shows: we recently ranked #71 out of 500 on the Forbes best startup employers list.

Founded in 2017 and backed by Andreessen Horowitz Y Combinator and Allegion Ventures is on a fast-paced journey to fulfill our mission: prevent every security incident possible.

Ready to learn more Connect with us on LinkedIn and YouTube

About the role:

Reporting to Raghu Nallamothu you will design build and optimize the AI infrastructure that powers real-time intelligence platform.

In this role you will work on the systems required to run state-of-the-art deep learning models across many terabytes of video data in real time. You will help build and scale infrastructure for inference evaluation and continuous model improvement across computer vision models large language models large vision models and multimodal AI systems.

This role is ideal for someone with a strong blend of infrastructure engineering production ML systems LLM/LVM inference evaluation harnesses and inference optimization experience. You will partner closely with research scientists and product engineering teams to bring the latest AI advancements into production for our customers.

What youll do:

• Design build and maintain cutting-edge AI infrastructure for real-time computer vision LLM LVM and multimodal inference workloads.

• Build scalable systems for running state-of-the-art models across large volumes of video and sensor data.

• Optimize inference performance across latency throughput GPU utilization reliability and cost.

• Develop robust evaluation harnesses and benchmarking systems to measure model quality system performance regressions and production readiness.

• Build infrastructure for continuous model evaluation experimentation and deployment.

• Partner with research scientists to productionize the latest advances in computer vision LLMs LVMs RAG and multimodal AI.

• Improve model-serving architecture including batching caching routing quantization model parallelism and hardware utilization.

• Develop data engines and feedback loops for collecting training data evaluating model behavior and continuously improving AI performance.

• Create reliable observability monitoring and debugging tools for production AI systems.

• Help define best practices for deploying evaluating and operating AI systems in real-world enterprise environments.

What youll bring:

• 4 years of industry experience building infrastructure distributed systems machine learning platforms or production AI systems.

• BS/MS in Computer Science or a related technical field or equivalent practical experience.

• Strong programming background especially in Python with solid software engineering fundamentals.

• Experience designing and building scalable machine learning infrastructure for training inference evaluation and deployment.

• Hands-on experience running deep learning models in production ideally including LLMs LVMs vision-language models or multimodal models.

• Strong understanding of inference optimization techniques including batching caching quantization parallelism memory optimization GPU utilization and latency reduction.

• Experience with model-serving frameworks or systems such as vLLM Triton Inference Server or similar technologies.

• Experience building evaluation frameworks test harnesses benchmarks regression tests or model-quality measurement systems.

• Strong background in machine learning and deep learning; computer vision experience is a strong plus.

• Experience designing data engines or pipelines for collecting managing and curating training and evaluation data.

• Familiarity with integrating advanced AI systems such as LLMs LVMs RAG pipelines embedding models or multimodal models into production applications.

• Experience with cloud infrastructure containers orchestration distributed systems and GPU-based workloads.

• Strong collaboration and communication skills with the ability to work effectively with research scientists product teams infrastructure teams and stakeholders.

• Proactive problem-solving ability a strong ownership mindset and adaptability to incorporate new AI technologies and methodologies.

• Experience operating large-scale GPU infrastructure or distributed inference systems.

• Experience with CUDA NCCL PyTorch TensorRT ONNX or similar ML systems technologies.

• Experience with video understanding real-time computer vision multimodal AI or physical-world AI systems.

• Experience with model compression speculative decoding distillation pruning or low-latency serving techniques.

• Experience with prompt evaluation model regression testing human-in-the-loop evaluation or automated quality gates.

• Familiarity with retrieval-augmented generation vector databases embedding models re-rankers or search infrastructure.

• Experience building internal ML platforms or tools used by researchers and applied ML teams.

You will be successful in this role if you can build practical scalable infrastructure that helps deploy better AI models faster and more reliably. You should be comfortable working across the full stack of production AI systems from model behavior and evaluation to serving architecture GPU performance observability and customer-facing reliability.

This is a hands-on engineering role for someone excited to help bring the next generation of AI computer vision LLMs and LVMs into real-world production environments.

Why join us:

• We are creating an entirely new category within a 180 billion-dollar physical security industry and looking for team members who are also passionate about our mission to prevent every security incident possible

• We partner with an incredible customer roster of F500 companies including Adobe TikTok Gap and SentinelOne

• Regular Full-time employees receive stock options for the opportunity to share ownership in the success of our company

• Comprehensive health welfare package (Medical Dental Vision Life EAP Legal Services 401k plan)

• We offer flexible time off to rest and recharge including Winter Break (time off between Christmas and New Years for most roles depending on customer demand)

• The latest tech and awesome swag will be delivered to your door

• Enjoy a full range of opportunities to connect with your awesome co-workers

• We love to hike are foodies and love music! Check out our most recent Ambient Spotify Playlist

Weve found that in-person time meaningfully supports collaboration creativity and team alignment. Our talent engineering product design and marketing teams work from our Redwood City office three days a week. All other Bay Area employees join on Fridays to stay connected and close out the week together.

Ready to learn more Connect with us onLinkedIn YouTube

#LI-Hybrid

is proud to be an Equal Opportunity Employer. Ambient does not unlawfully discriminate on the basis of race color religion sex (including pregnancy childbirth breastfeeding or related medical conditions) gender identity gender expression national origin ancestry citizenship age physical or mental disability legally protected medical condition family care status military or veteran status marital status registered domestic partner status sexual orientation genetic information or any other basis protected by local state or federal laws. Ambient is an E-Verify participant.

Required Experience:

Senior IC