Sr. Software Engineer Agentic Evaluation

Join the team redefining what a deeply personal and integrated assistant can be. nnAs part of the Siri organization you will help shape one of the worlds most widely used AI assistants powered by our next-generation of Apple Intelligence with capabilities like personal context understanding and on-screen awareness built with privacy from the ground up. Your work will have direct meaningful impact for users across iOS iPadOS macOS watchOS and is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design shipping technology that is centered around users and their needs.

In this role youll contribute to the infrastructure tooling and pipelines that let us evaluate Siri reliably and at scale. Youll have meaningful autonomy in how you get there and the work will move across several areas of expansion as priorities evolve. The specific platforms frameworks and components will change over time so were looking for someone who can transition smoothly across them and bring strong evaluation and systems engineering fundamentals to whatever the team needs next.

Extending evaluation capabilities to new devices platforms and runtime environments with designs that favor portability over any single targetnSupporting the evaluation of new Siri features and interaction modalities working from ambiguous early requirements toward concrete automated coveragenDiagnosing failures across the stack from environment provisioning through pipeline execution to scoring enabling auto-diagnostics and driving durable fixesnContributing to architecture decisions for the teams evaluation systemsnPartnering across engineering infrastructure and program teams to align on interfaces priorities and shared standards

Strong programming skills in one or more compiled languages (Swift C or Objective-C).nPython scripting skills for tooling and automationnSolid understanding of computer science fundamentalsnAbility to quickly learn new technologies and adapt to evolving requirementsnExcellent communication skills and ability to collaborate across teamsnM.S. or B.S. in Computer Science Machine Learning or related field (or equivalent experience)

Experience staging provisioning or controlling test or evaluation environments to produce repeatable deterministic conditionsnExperience evaluating ML LLM or agent-based systems including familiarity with metrics scoring methodology or trajectory and outcome analysisnExperience designing or operating test infrastructure at scale such as device provisioning environment restore warm pools or continuous integration systemsnProficiency with Python and Swift in a production settingnA track record of approaching problems flexibly and cutting through ambiguity adapting your approach to reach the right outcome and setting a clear path when requirements are not yet definednA talent for focusing and simplifying stripping away what is not essential and distilling complex decisions down to the factors that matternA history of collaborating across teams and communicating effectively with both technical and program audiences