AIML Sr Machine Learning Engineer, DMLI

We are looking for talented machine learning engineers who are excited to tackle some of the most meaningful and technically challenging problems in building and deploying foundation modelbased products for our customers. nAs a Machine Learning Engineer focused on foundation model evaluation you will play a critical role in assessing the capabilities of the models that power Apple Intelligence features. nYou will work closely with machine learning researchers to translate evaluation insights into actionable improvements that advance future model performance.n

As a foundation model evaluation Machine Learning Engineer you will be entrusted with ensuring that foundation model performance can be measured quickly and reliably in order to support crucial model shipping decisions. nYou will design implement and maintain crucial evaluation infrastructure. nYou will collaborate extensively with ML researchers on both model hillclimbing and developing novel methodologies for measuring model performance. nYour responsibilities will span a number of high-impact parts of the Apple product and foundation model lifecycle.n

Ensure the stability reliability and performance of Apples foundation model evaluation and implement novel evaluation design and implement tooling to simplify metrics generation ingestion and agentic LLM systems to facilitate and improve model evaluations.n

5 years of hands on ML engineering experiences with at least 1 years working directly on large language models or generative Masters or PhD in Computer Science Machine Learning or a related technical field or equivalent practical software engineering fundamentals: debugging testing code reviews and production reliability / -on experience with LLM training and / or evaluation workflows including any of the following: pre-training post-training online evaluation offline evaluation automated evaluation human evaluation.n

Hands on experience with evaluating large language models at scale or designing large language model communication skills able to clearly and concisely convey important -motivated and curious. Strive to continually learn on the level of creative and critical thinking skills with an innate drive to improve how things work. Have a high tolerance for ambiguity and the ability to identify the most important problems to solve.n