Sr Engineering Program Manager, Evaluation Special Projects
Share
Job Location:
Cupertino, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
As the EPM for Evaluation you will:Strategic Leadership & Vision:- Partner with technical teams to define and drive the evaluation strategy for Apples AI models influencing product roadmaps and technology investments.- Partner with stakeholders to align evaluation frameworks with product vision and business Program Management:- Develop end-to-end programs to measure and validate performance of state-of-the-art multi-modal models.- Drive consensus on subjective quality metrics establishing clear success criteria for ambiguous use cases.- Orchestrate complex data collection initiatives simulation infrastructure and evaluation pipelines.- Deliver process improvements that increase efficiency across the broader -functional Leadership:- Coordinate distributed teams across design engineering research and operations.- Communicate complex technical concepts and program status directly to executive leadership.
- 7 years of technical program management experience with at least 3 years leading complex AI/ML programs.
- Proven track record of delivering complex programs by defining clear requirements and driving engineering teams to successful outcomes.
- Experience influencing and driving decisions at Director/VP level.
- Strong ability to navigate ambiguity and lead teams through uncertainty while maintaining program momentum.
- Excellence in executive communication - ability to distill complex technical information with the right balance of detail.
- Masters or PhD in Computer Science Machine Learning Statistics or related quantitative field.
- Deep hands-on experience with large language models (LLMs) vision-language models (VLMs) and multi-modal architectures.
- Demonstrated mastery of ML concepts evaluation methodologies and the end-to-end model development lifecycle.
- Experience with reinforcement learning from human feedback (RLHF) and preference optimization.
- Expertise in statistical analysis A/B testing and experimental design at scale.
Required Experience:
Manager
Key Skills
- Project Management Methodology
- Project / Program Management
- Program Management
- Management Experience
- Microsoft Powerpoint
- Project Management
- Microsoft Project
- Budgeting
- DoD Experience
- Leadership Experience
- Supervising Experience
- Contracts
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more
