AI/ML Model Runtime Engineer
AI/ML Model Runtime Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Please Note:
1. If you are a first time user please create your candidatelogin account before you apply for a job. (Click Sign In > Create Account)
2. If you already have a Candidate Account please Sign-In before you apply.
Job Description:
Broadcom is looking for a Systems Engineer to join VMware Cloud Foundations (VCF) AI and Advanced Services team. This position is key to building a best in class private cloud AI platform. You will have a high impact by playing a critical role designing and implementing scalable solutions along with a team of talented and enthusiastic engineers.
This role will be a member of the Private AI Services Model Runtime team which is a Kubernetes based control plane that operates ML inferencing services. The successful candidate must have experience contributing to Open Source projects and experience participating in upstream Kubernetes and related CNCF projects as a contributor is a major plus.
The AI & Advanced Services team is responsible for building AI platform capabilities into the VMware Cloud Foundation product to enable our enterprise customers to have all of the AI platform features they need to build deploy test manage and scale their AI infrastructure and workloads.
Responsibilities
Collaborate with cross-functional teams to design and deliver expanded capabilities of Kubernetes-based platform services for AI
Troubleshoot and resolve complex issues related to Private AI inference services and their performance
Augment the AI services platform to support diverse inferencing and embedding engines (e.g. vLLM or HuggingFace Transformers library)
Develop enhancements to the AI services platform to support a large set of ML models
Participate in code reviews and ensure that the code is aligned with VMwares coding standards and best practices
Develop and maintain automated tests to ensure the quality and reliability of the Private AI feature set
Requirements
Ability to succeed on an take-home homework assignment and in-person technical interview including coding and debugging
5 years experience in production quality Python code
5 years of hands on experience with Container technologies (Docker and Kubernetes)
Experience with CUDA or other numeric computing libraries and their Python bindings is a plus
Strong analytical and diagnostic skills with ability to independently solve complex problems
Excellent communication and collaboration skills with the ability to work with cross-functional teams
Experience with agile development methodologies and version control systems such as Git
BS in Computer Science or related technical fields and 12 years of related experience in the software industry or MS in Computer Science or related technical fields and 10 years of related experience in the software industry
Candidate should not require work visa / sponsorship
What We Offer:
Competitive salary and benefits package
Opportunities for career growth and professional development
Collaborative and dynamic work environment
Access to cutting-edge technologies and tools
Additional Job Description:
Compensation and Benefits
The annual base salary range for this position is$127100 - $226000.
This position is also eligible for a discretionary annual bonus in accordance with relevant plan documents and equity in accordance with equity plan documents and equity award agreements.
Broadcom offers a competitive and comprehensive benefits package: Medical dental and vision plans 401(K) participation including company matching Employee Stock Purchase Program (ESPP) Employee Assistance Program (EAP) company paid holidays paid sick leave and vacation time. The company follows all applicable laws for Paid Family Leave and other leaves of absence.
Broadcom is proud to be an equal opportunity employer. We will consider qualified applicants without regard to race color creed religion sex sexual orientation national origin citizenship disability status medical condition pregnancy protected veteran status or any other characteristic protected by federal state or local law. We will also consider qualified applicants with arrest and conviction records consistent with local law.
If you are located outside USA please be sure to fill out a home address as this will be used for future correspondence.
Employment Type
Full-Time
