Engineering Manager, ML Infrastructure Moveworks
Share
Job Location:
Mountain View, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
1 hour ago
Vacancies:
1 Vacancy
Job Summary
The Role
As the Engineering Manager for the Machine Learning Infrastructure team you will spearhead the development of the cutting-edge platform that powers Moveworks conversational AI. This role is absolutely critical to the long-term scalability of our core AI product and ultimately the company.
Your primary mission is to lead a team of talented engineers in building optimizing and scaling the end-to-end systems for the entire ML/LLM lifecycle. This includes our infrastructure for distributed training and inference model evaluation frameworks and LLM latency optimization. You will guide the teams technical vision balancing the operational demands of our core ML infrastructure with forward-looking research to build the next generation of LLMs using cutting-edge generative AI.
The frameworks your team builds serve as the foundation for all ML models in production serving hundreds of millions of enterprise employees. Your contributions will be instrumental in shaping the Moveworks Enterprise Copilot platform and defining the future of AI-driven employee services.
What you get to do in this role:
- Lead Mentor and Grow a world-class team of ML and Systems Engineers fostering a culture of innovation ownership and operational excellence that aligns with Moveworks core principles.
- Own the Technical Vision and roadmap for the end-to-end ML platform that powers the entire lifecyclefrom data synthesis and distributed training to ultra-low-latency inference and servingfor hundreds of production models including our proprietary MoveLM series.
- Drive the Strategy for model performance and efficiency making critical architectural decisions to optimize our GPU infrastructure for latency throughput and cost at massive scale.
- Partner with Leaders across agentic platform search platform product engineering and core infrastructure teams to define and deliver the foundational infrastructure that will power the next generation of agentic AI experiences.
- Champion a Product Mindset for your platform building powerful abstractions and tools that accelerate the velocity of machine learning engineers and researchers across the organization.
Qualifications :
To be successful in this role you have:
- A Masters or Ph.D. in Computer Science Machine Learning or a related field.
- 5 years of industry experience with a proven track record of leading or managing high-performing machine learning or infrastructure teams.
- Deep technical expertise in designing building and scaling end-to-end machine learning systems in production environments.
- Strong command of Python and experience with performant languages such as C or GoLang.
- Extensive experience with deep learning frameworks like PyTorch or Hugging Face.
- Hands-on experience with modern LLM infrastructure including distributed training frameworks (e.g. Deepspeed) and inference/serving frameworks (e.g. vLLM TensorRT-LLM Kubernetes).
- A strategic mindset with experience balancing the demands of operating robust scalable infrastructure with the need for forward-looking research and development.
- Excellent communication and collaboration skills with experience working cross-functionally to deliver complex projects.
Additional Information :
Work Personas
We approach our distributed world of work with flexibility and trust. Work personas (flexible remote or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race color creed religion sex sexual orientation national origin or nationality ancestry age disability gender identity or expression marital status veteran status or any other category protected by addition all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process or are unable to use this online application and need an alternative method to apply please contact for assistance.
Export Control Regulations
For positions requiring access to controlled technology subject to export control regulations including the U.S. Export Administration Regulations (EAR) ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.
From Fortune. 2025 Fortune Media IP Limited. All rights reserved. Used under license.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- IT Experience
- Project Management Methodology
- Data Center Experience
- LAN
- Cloud Infrastructure
- Computer Networking
- Visio
- ITIL
- Project Management
- SAN
- Microsoft Project
- Project Management Lifecycle
About Company
Learn here. Grow here. Make a difference here. At ServiceNow, our cloud?based platform and solutions deliver digital workflows that create great experiences and unlock productivity for employees and enterprises. Were growing fast, innovating even faster, and making an impact on our c ... View more
