Enter a job title or keyword
AIML Sr Applied AI Scientist GenAI Model Autograding, Evaluation
Job Location:
Job Location:
Cupertino, CA - USA
Monthly Salary:
Not provided by the employer
Monthly Salary:
Posted:
22 August 2026 (22 days ago)
Posted:
Application Deadline:
19 November 2026
Application Deadline:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Do you get excited by building AI applications to enhance the evaluation of various Apple AI products Our Evaluation organization is responsible for providing principled assessments across a diverse range of Apple features from Search and Siri to the latest Apple Intelligence capabilities. nWithin this critical function our team specializes in leveraging advanced AI/ML techniques to enhance both the quality and efficiency of these comprehensive evaluations. nnWe are seeking a highly innovative and passionate Applied AI Scientist to develop cutting-edge AI/ML models for the automatic grading and quality assessment of our internal GenAI products. nn
In this pivotal role you will design and advance state-of-the-art autograder systems that evaluate various AI product quality at scale. nYou will apply deep expertise in prompt engineering foundation model adaptation and evaluation methodology to build robust trustworthy and extensible autograders that assess product performance user experience and adherence to quality and safety standards. nThen you will collaborate with product annotation evaluation data scientists autograder tooling engineers to deploy the state-of-the-art autograders directly impacting the quality and success of Apples next-generation AI-powered features. nnn
Extensive experience with prompting understanding of GenAI models and 1 year of industry experience in building or evaluation GenAI models. nFamiliarity with LLMOps processes for deploying monitoring and hillclimbing AI models in production environments. nExcellent analytical skills and judgement capable of assessing data quality diagnosing autograder limitations or biases synthesizing findings into actionable insights and communicating them clearly across degree in Computer Science Machine Learning AI or a related mindset with the flexibility to take on whatever tasksincluding annotation or operational workare necessary to deliver
Experience in developing AI models specifically for quality assessment or automated feedback generation. nFamiliarity with human annotation operations sampling strategies or subjective judgment in designing human-in-the-loop evaluation with image quality passion for leveraging AI to improve work efficiency and
In this pivotal role you will design and advance state-of-the-art autograder systems that evaluate various AI product quality at scale. nYou will apply deep expertise in prompt engineering foundation model adaptation and evaluation methodology to build robust trustworthy and extensible autograders that assess product performance user experience and adherence to quality and safety standards. nThen you will collaborate with product annotation evaluation data scientists autograder tooling engineers to deploy the state-of-the-art autograders directly impacting the quality and success of Apples next-generation AI-powered features. nnn
Extensive experience with prompting understanding of GenAI models and 1 year of industry experience in building or evaluation GenAI models. nFamiliarity with LLMOps processes for deploying monitoring and hillclimbing AI models in production environments. nExcellent analytical skills and judgement capable of assessing data quality diagnosing autograder limitations or biases synthesizing findings into actionable insights and communicating them clearly across degree in Computer Science Machine Learning AI or a related mindset with the flexibility to take on whatever tasksincluding annotation or operational workare necessary to deliver
Experience in developing AI models specifically for quality assessment or automated feedback generation. nFamiliarity with human annotation operations sampling strategies or subjective judgment in designing human-in-the-loop evaluation with image quality passion for leveraging AI to improve work efficiency and
Required Experience:
Senior IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more
