Machine Learning Engineer, Foundation Model Services
Santa Clara County, CA - USA
Job Summary
* Work closely with product teams to build production grade solutions to launch models serving millions of customers in real time. nn* Work along side Foundation Model Research team to prototype and develop inference for cutting edge model architectures. nn* Build tools to understand bottlenecks in Inference for different hardwares and use cases.
5 year industry experience in ML technologies (LLMs Machine Learning NLP Information Retrieval Statistics).nExperience with high throughput services particularly at supercomputing with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes Docker in building and maintaining systems written in modern languages (eg: Golang python)nBachelors degree or higher in Computer Science or related technical field.
Familiar with one of the popular ML Frameworks like Pytorch with fundamental Deep Learning architectures such as Transformers Encoder/Decoder with Nvidia TensorRT-LLM vLLLM DeepSpeed Nvidia Triton Server etc.
Required Experience:
IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more