Sr. Engineering Manager, AIML Serving Platform

Job Location:

San Francisco, CA - USA

Monthly Salary: Not Disclosed

Posted on: Yesterday

Vacancies: 1 Vacancy

Job Summary

Sr. Engineering Manager AI/ML Serving Platform

The AI/ML Serving Platform team provides foundational tools and infrastructure used by hundreds of AI/ML engineers across Pinterest including recommendations ads visual search growth/notifications trust and safety. We aim to ensure that AI/ML systems are efficient healthy (production-grade quality) and fast (for modelers to iterate upon).

Pinterest is seeking a Sr. Engineering Manager to lead the team that builds the serving and deployment infrastructure for all AI/ML models at Pinterest. Systems include:

Ultra-high-performance C model inference engine for production recommendations and content ranking systems. TorchScript CUDA Graph models on GPU inference serving 500M inferences/second.
Production GenAI & LLM model inference stack for emerging use cases.
Model routing deployment monitoring. Kubernetes-based provisioning.
Feature fetching caching and logging

What youll do

Lead the team to deliver continual improvements in advanced model architectures cost-efficient resource utilization and AI/ML developer productivity.
Set technical direction for the team based on company and org priorities
Coach and develop talent on the team.

What were looking for:

Experience managing platform engineering teams with many cross-organizational customers
Experience leading the development of large-scale distributed serving systems
Experience with AI/ML inference technologies (e.g. PyTorch TensorFlow) for online serving at Web scale
Bachelors degree in Computer Science a related field or equivalent experience.

In-Office Requirement Statement:

We let the type of work you do guide the collaboration style. That means were not always working in an office but we continue to gather for key moments of collaboration and connection.
This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country.

Relocation Statement:

This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.

#LI-REMOTE

#LI-AH2

Required Experience:

Manager

Sr. Engineering Manager AI/ML Serving PlatformThe AI/ML Serving Platform team provides foundational tools and infrastructure used by hundreds of AI/ML engineers across Pinterest including recommendations ads visual search growth/notifications trust and safety. We aim to ensure that AI/ML systems are...