AIML Data Scientist, Evaluation

Do you get excited by building software systems to enhance the automatic evaluation of various Apple AI products Our Evaluation organization is responsible for providing principled assessments across a diverse range of Apple features from Search Siri to the latest Apple Intelligence capabilities. As part of our online metrics and insights team we are looking for a Sr Data Scientist to contribute to product understanding and development of Apple features. This role involves using analytical and engineering methods augmented by LLMs and python to develop conceptual and analytical models and perform insights analyses to uncover product quality issues that can inform improving the overall user experience.

As a Sr Data Scientist you will use statistical and LLM analysis of structured and linguistic data to deepen our understanding of Apples AI product and support the development of future versions. Investigate world-wide product usage to identify weaknesses and chances to create the product better. Define metrics and instrumentation strategies to assess the success of new features. Build relationships with Engineering leads and product partners to drive a privacy-first strategy for analytical insight. Employ a diverse toolkit of detailed analytical approaches methodologies frameworks and technical strategies with a particular focus on language data analysis. Build credibility with partners through clarity and structured critical thinking.

3 years of data science experience applying quantitative methods to structured and unstructured data for exploratory data analysis pattern recognition metrics development and analytical programming skills in Python and SQL with experience in data manipulation processing and analytics with LLM-driven analytics workflows using Python coding frameworks and evaluation ability to analyze user behavior design and interpret A/B experiments and translate findings into product degree in a technical or quantitative field such as Statistics Mathematics Computer Science Engineering Linguistics or Physics (PhD preferred).

Experience with Natural Language Processing (NLP) and with development of dataset and analysis conceptual -motivated and curious with demonstrated creative and critical thinking capabilities and a highly developed drive to determine and improve how things communication skillsable to synthesize analyses into clear insights and influence multi-functional tolerance for ambiguity. You find a way through. You anticipate. You connect and experience in encouraging partner relationships and influencing decisions with data.