Data Scientist Synthetic Data and ML Evaluations Special Projects

Apple is where individual imaginations gather together committing to the values that lead to great work. Every new product we build service we create or experience we deliver is the result of us making each others ideas stronger. The diversity of our people and their thinking inspires the innovation that runs through everything we do. When we bring everybody in we can do the best work of our lives. Here youll do more than join something youll add something.

The Special Projects team at Apple is developing novel user-facing conversational features that leverage the multimodal capabilities of state-of-the-art foundation models. A key component of this process is the ability to produce complex simulated scenario data in order to train and evaluate agentic AI models. We are looking for a skilled Data Scientist to work closely with our Simulation and Machine Learning Evaluations teams to generate large synthetic datasets analyze the gap between simulated and real data and evaluate and fine-tune agentic AI model performance at various tasks. A successful candidate is experienced in managing large multi-modal datasets in translating subjective product requirements into objective criteria and has strong statistical analysis skills.

Work closely with ML Engineers to understand model evaluation needsnWork closely with the Simulation team to design and generate large multi-modal datasets for model evaluationnAnalyze the gap between simulated and real datanCollaborate with the Simulation team to prioritize and address simulation performance gaps

BA or Masters degree in Computer Science Data Science or related fieldn2 years of hands-on experience working with large data setsnProficiency in PythonnExcellent communication skills

PhD in Computer Science Data Science Statistics or other STEM fieldnHands-on industry experience with product focused statistical analysisnExperience working with large-scale multimodal data and data-annotation pipelinesnExperience working with simulations to produce large datasetsnExperience with experimental design A/B testing and Failure AnalysisnA track record of publications or technical presentations in Data SciencenExcellent cross-functional collaboration skills