Senior GenAI Engineer, Apple Cloud AI
Cupertino, CA - USA
Job Summary
Join Apples Cloud AI as a Senior GenAI Engineer where youll be at the forefront of delivering transformative AI experiences across Apple products including Apple Music TV Sports and many more. You will play a pivotal role in defining and driving the roadmap for Apple Cloud GenAI and Agentic Platform component which powers the development evaluation and deployment of AI agents and applications. This includes building foundational capabilities such as agent orchestration model configuration prompt tooling RAG integration and inference optimization enabling teams across Apple to rapidly create scalable context-aware GenAI solutions. You will collaborate closely with cross-functional teams of innovative software engineers product managers and engineering leaders to continuously evolve the platform for performance flexibility and ease of use.n
Design and development of platform capabilities such as agent orchestration agentic RAG LLM model configuration prompt optimization tooling and fine-tuning and RL pipelines that meet the highest standard in security and safetynDrive efforts around LLM and Agent optimization including caching prompt tuning and latency improvements ensuring efficient and cost-effective model usage across agentic systemsnDefine and drive the technical roadmap and strategy for Apple Cloud AI GenAI components enabling scalable and secure development and deployment of agentic systems and harnessesnCollaborate with engineering product and operations teams across Apple to ensure effective adoption of GenAI capabilities in high-impact workflowsnPartner with stakeholders to build reusable AI agents that enhance productivity automate reasoning tasks and integrate securely with internal systems and toolsnMentor new hires and fellow engineers fostering growth in technical depth and platform mindsetnEstablish best practices and processes that ensure engineering excellence operational sustainability and a seamless developer experiencenPromote a healthy inclusive and innovation-driven team culture with a focus on experimentation learning and long-term platform impactn
4 years of machine learning and software development experiencen1 years of experience as a technical lead guiding teams through complex design decisions and setting high benchmarks for code quality performance and scalabilitynHands-on experience designing and building GenAI platforms that allow users to create configure and deploy AI Agents supporting features like agent orchestration prompt engineering RAG integration and model selectionnExperience building AI agents capable of complex multi-step reasoning and tool usage with a focus on reliability traceability and composabilitynExperience building and deploying Agent Harnesses including integrations with Agent Memory and Context MCP and tools and runtime secure environments (Agent Sandboxes)nIn-depth understanding of security primitives for AI Agents and Harnesses including policy enforcement MCP/tools access control runtime security drift and hallucination detection for long horizon -depth understanding of large language models (LLMs) and their application in AI-driven solutions including inferencing embedding and knowledge base integration (RAG) for improved data retrieval and contextualizationnKnowledge of LLM inference optimization techniques including prompt tuning caching quantization and latency reduction across different model familiesnStrong programming skills in Python Java or similar languages with an emphasis on AI/ML systems development and platform engineeringnDemonstrated ability to work cross-functionally and influence product development through a combination of technical leadership and user-centered thinkingnPassion for operational excellence automation and delivering scalable developer-friendly AI infrastructurenB.S M.S. or PhD Degree in Computer Science/Engineering or equivalent work experience
Expertise in 3rd party Cloud Environments (Google Cloud and AWS)nHands on experience in using Kubernetes as orchestration layernProven experience in customizing foundation models to improve task-specific performance and domain alignmentn
Required Experience:
Senior IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more