SeniorStaff Applied ML Engineer – AIML Evaluation & Simulation
Share
Job Location:
San Francisco, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
19 days ago
Vacancies:
1 Vacancy
Job Summary
Were looking for a pragmatic engineer who thrives at the intersection of machinelearning and software development capable of building robust scalable systems thatsupport evaluation and development of advanced AI capabilities including largelanguage models and agentic behaviors.A successful candidate is comfortable navigating ML systems and product bring strong software engineering fundamentals experience building andmaintaining end-to-end pipelines and a practical understanding of how to evaluate AIsystems in real-world contexts. Youre curious about how LLMs behave in interactive oragentic settings thoughtful about evaluation design and eager to build tools thatimprove visibility and trust in AI. Above all you enjoy collaborating across disciplinesand bringing structure to complex evolving problems.
- 8 years of experience in software engineering ML engineering or applied ML roles
- Proficiency in Python or another modern programming language (e.g. Java Go Swift)
- Experience building and maintaining production-grade systems
- Solid understanding of machine learning concepts especially LLMs and their
- applications
- Excellent communication and collaboration skills with cross-functional partners
- Experience working on AI evaluation systems LLM-based simulations or agentic AI
- frameworks
- Background in building tools for data analysis model evaluation or synthetic data
- generation
- Familiarity with metrics instrumentation and observability in ML systems
- Experience designing pipelines for AI/ML workflows
- Exposure to applied research generative models or real-time systems
- Understanding of how model quality connects to product outcomes and user
- experience
Required Experience:
Staff IC
Key Skills
- Computer Science
- Docker
- Kubernetes
- Python
- VMware
- C/C++
- Go
- System Architecture
- gRPC
- OS Kernels
- Perl
- Distributed Systems
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more
