Machine Learning Engineer Speech & Multimodal Language Modeling

Apple is where individual imaginations gather together committing to the values that lead tongreat work. Every new product we build service we create or experience we deliver is thenresult of us making each others ideas stronger. The diversity of our people and their thinkingninspires the innovation that runs through everything we do. When we bring everybody in wencan do the best work of our lives. Here youll do more than join something youll addnsomething.

The Special Projects team at Apple is developing novel user-facing features that leverage thenmultimodal capabilities of state-of-the-art foundation language models. We are looking for anhighly skilled Machine Learning Engineer to build and evaluate these experiences with anspecific focus on Multimodal and Speech Language Models. A successful candidate isnexperienced in evaluating complex foundation model-driven systems end-to-end translatingnsubjective product requirements into objective criteria has strong statistical analysis skills andnhas worked with Speech Language Models.

Design and implement processes for evaluating and improving multi-modal generativenmodels to meet end-to-end product requirements.n Work with Data Engineers to process large scale speech audio data for foundation modelntrainingn Fine-tune Large Language Models (LLMs) and Speech Language Models (SpeechLMs) tonimprove performance for specific use casesn Work closely with other ML Researchers to define evaluation criteria and methodology tonsystematically evaluate foundation modelsn Experimental design for testing models/systems under testn Conduct robust statistical analysis to identify model deficiencies and failure states

Masters degree in Computer Science or Machine Learningn 2 years of hands-on experience building and evaluating generative AI modelsn Proficiency in Python and ML frameworks (Pytorch or Tensorflow)

PhD in Computer Science Machine Learning Statistics or other STEM fieldn 5 years of hands-on experience with SpeechLMs or LLMsn Experience with large-scale audio data processing on distributed systemsn Experience with prompt evaluation and optimization for generative AI modelsn Proficiency in training fine-tuning and evaluation of foundation models and frameworksn A track record of publications or technical presentations in Machine Learning journals ornconferencesn Excellent communication skills and cross-functional collaboration