drjobs Senior/Staff Applied ML Engineer – AI/ML Evaluation & Simulation

Senior/Staff Applied ML Engineer – AI/ML Evaluation & Simulation

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

San Francisco, CA - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Were looking for a pragmatic engineer who thrives at the intersection of machinelearning and software development capable of building robust scalable systems thatsupport evaluation and development of advanced AI capabilities including largelanguage models and agentic behaviors.A successful candidate is comfortable navigating ML systems and product bring strong software engineering fundamentals experience building andmaintaining end-to-end pipelines and a practical understanding of how to evaluate AIsystems in real-world contexts. Youre curious about how LLMs behave in interactive oragentic settings thoughtful about evaluation design and eager to build tools thatimprove visibility and trust in AI. Above all you enjoy collaborating across disciplinesand bringing structure to complex evolving problems.


  • 8 years of experience in software engineering ML engineering or applied ML roles
  • Proficiency in Python or another modern programming language (e.g. Java Go Swift)
  • Experience building and maintaining production-grade systems
  • Solid understanding of machine learning concepts especially LLMs and their
  • applications
  • Excellent communication and collaboration skills with cross-functional partners


  • Experience working on AI evaluation systems LLM-based simulations or agentic AI
  • frameworks
  • Background in building tools for data analysis model evaluation or synthetic data
  • generation
  • Familiarity with metrics instrumentation and observability in ML systems
  • Experience designing pipelines for AI/ML workflows
  • Exposure to applied research generative models or real-time systems
  • Understanding of how model quality connects to product outcomes and user
  • experience

Required Experience:

Staff IC

Employment Type

Full-Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.