Automation and Triage Engineer, Siri
Cupertino, CA - USA
Job Summary
As an Automation and Triage Engineer for Siri Quality you will build the tools and systems that hold Siri to the highest standard. Youll design frameworks and automated pipelines that rigorously test how Siri performs across Apple platforms - evaluating whether it truly understands user intent leverages available on-device context and delivers an experience that feels effortless and intelligent. Your work transforms subjective quality into measurable signal giving engineering and ML teams the clarity they need to move fast and ship with confidence.
Design and maintain end-to-end test automated test suite for Siri across iOS macOS iPadOS CarPlay and other Apple and scale evaluation scenarios that reflect real-world user intent and on-device and triage complex failures across Siris AI stack planner behavior tool execution search context retrieval and response true product regressions from infrastructure noise and drive root cause analysis to clear actionable with engineering ML and product experience teams to define quality metrics track regressions and validate improvements before they ship.
Bachelors Degree in Computer Science or related field. n8 years of experience in a software development or test engineering role with demonstrated leadership in quality strategy and software engineering fundamentals with hands-on experience in Python Swift or both and a track record of building test automation frameworks CI/CD pipelines or evaluation infrastructure for complex software with agentic coding systems using AI-assisted development tools to accelerate implementation prototype evaluation pipelines and tackle complex engineering problems with speed and with machine learning concepts and LLM-based systems - including evaluation methodologies prompt design and model behavior analysis.
Experience with on-device AI natural language understanding or conversational systems is a strong plus as is familiarity with scenario-based testing or agent trajectory analysis. nPrior work on quality or reliability for consumer-facing AI products is especially valued.
Required Experience:
IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more