Principal Evaluation Architect, Siri Evaluation Engineering

Join the team redefining what a deeply personal and integrated assistant can be. nnAs part of the Siri organization you will help shape one of the worlds most widely used AI assistants powered by our next-generation of Apple Intelligence with capabilities like personal context understanding and on-screen awareness built with privacy from the ground up. Your work will have direct meaningful impact for users across iOS iPadOS macOS watchOS and visionOS. This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design shipping technology that is centered around users and their are seeking a senior Eval Systems Architect to own the end-to-end technical vision and system architecture across our entire evaluation stack ensuring that we build toward a coherent scalable and trustworthy system.

As the Eval Systems Architect you will own the technical architecture of Siris evaluation infrastructure a system spanning real-device automation simulated product evaluation AI-powered auto-evaluators developer workflows and observability tooling. You will work across the Agentic Eval Engineering and Siri to ensure architectural coherence define interfaces and contracts between systems and drive the technical roadmap for the evaluation platform as a is not a role where you design in isolation. You will embed with teams understand their systems deeply and make architectural decisions that balance local team autonomy with system-wide consistency. You will lead a first-principles review of existing evaluation tooling and infrastructure identifying gaps redundancies and opportunities to simplify or unify. You will represent the technical perspective in leadership discussions influence build-vs-integrate decisions and set the standards that enable teams to move fast without creating work will directly influence how Apple evaluates its most important AI products. Your architectural decisions will impact the speed confidence and quality with which Siri ships to billions of users.n

BS/MS/PhD in Computer Science Software Engineering or a related field.n10 years of software engineering experience with at least 5 years in a systems architecture staff/principal engineer or technical leadership track record of designing and shipping large-scale distributed systems serving multiple teams or expertise in system design: API design service architecture data flow modeling interface contracts and schema software engineering fundamentals with production experience including CI/CD testing strategies system monitoring debugging complex multi-service systems and code expertise in using AI-assisted software development workflows to accelerate engineering while maintaining code quality.

Experience architecting evaluation testing or quality infrastructure at scale particularly for AI/ML products where quality is non-binary and with building LLM applications LLM-as-judge evaluation frameworks and offline evaluation with MLOps principles for model lifecycle management and training data with VM orchestration fleet management or large-scale job scheduling of simulation and service virtualization techniques for complex software with observability platforms (metrics logging tracing dashboarding) and defining SLOs for platform with agentic AI systems including tool-use multi-step reasoning and human-in-the-loop record of leading cross-team architectural initiatives (e.g. platform migrations API unification system consolidation) in organizations with 50 engineers