Sr. Engineering Manager, ML Serving Platform
Sr. Engineering Manager, ML Serving Platform
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
The ML Platform team provides foundational tools and infrastructure used by hundreds of ML engineers across Pinterest including recommendations ads visual search growth/notifications trust and safety. We aim to ensure that ML systems are efficient healthy (production-grade quality) and fast (for modelers to iterate upon).
Pinterest is seeking a Sr. Engineering Manager to lead the team that builds the serving and deployment infrastructure for all ML models at Pinterest. Systems include:
- Ultra-high-performance C model inference engine for production recommendations and content ranking systems. TorchScript CUDA Graph models on GPU inference serving 500M inferences/second.
- Production GenAI & LLM model inference stack for emerging use cases.
- Model routing deployment monitoring.
- Feature fetching caching and logging.
What youll do:
- Lead the team to deliver continual improvements in advanced model architectures cost-efficient resource utilization and ML developer productivity.
- Set technical direction for the team based on company and org priorities.
- Coach and develop talent on the team.
What were looking for:
- Experience managing platform engineering teams with many cross-organizational customers
- Experience building large-scale distributed serving systems
- Experience with ML inference technologies for online serving at Web scale
- Experience developing engineering platforms: deep customer understanding
- Bachelors degree in Computer Science a related field or equivalent experience
In-Office Requirement Statement:
- We let the type of work you do guide the collaboration style. That means were not always working in an office but we continue to gather for key moments of collaboration and connection.
- This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country.
Relocation Statement:
- This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.
#LI-REMOTE
#LI-JT1
Required Experience:
Manager
Employment Type
Full Time
