Senior Technical Product Manager AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home
San Francisco, CA - USA
Job Summary
Senior Technical Product Manager - AI Agents Evals & Reliability Artificial Intelligence (AI) Required Work From Home
We are looking for a Senior Technical Product Manager. This is a deeply technical hands-on role. The Senior Technical Product Manager will work directly with engineers on systems design evaluation and trade-offs-defining requirements but shaping how the system works for global users. The Senior Technical Product Manager will work at the intersection of user needs model capability and system constraints and are responsible for turning AI potential into real reliable behavior in a real-world application. Artificial Intelligence (AI) and Machine Learning (ML) experience are required for this position. This position is 100% Remote.
MUST BE WILLING TO TAKE A 60 MINUTE CODING ASSESSMENT.
Senior Technical Product Manager Responsibilities:
- Research and define end-to-end Artificial Intelligence (AI) system requirements from capability to behavior to user impact.
- Translate model capabilities data constraints and evaluation results into clear product and system decisions.
- Make hard trade-offs across quality latency cost reliability and User Experience (UX).
- Work closely with Machine Learning (ML) backend and mobile engineers on system design evaluation and iteration.
- Define and evolve evaluation frameworks across offline metrics online experiments and human feedback.
- Drive execution with clear specs strong judgment and disciplined prioritization.
- Ensure systems ship quickly safely and reliably with strong feedback loops.
- Own product quality end-to-end including correctness predictability and user trust.
Outcomes:
- Product strategy clearly aligns AI capabilities with user needs and company priorities.
- Artificial Intelligence (AI) features deliver real value are understandable predictable and trusted by users.
- Decisions balance quality speed cost and reliability effectively under uncertainty.
- Roadmaps and priorities are clear with fast iteration based on real user feedback.
- Teams are aligned focused and able to execute Artificial Intelligence (AI) product goals with minimal friction.
Qualifications :
Senior Technical Product Manager Qualifications:
Technical Foundation:
- Strong grounding in computer science fundamentals including algorithms data structures and system design.
- Solid understanding of Machine Learning (ML) fundamentals and how modern Artificial Intelligence (AI) systems behave in production.
- Comfort reading reviewing and discussing technical design documents.
Artificial Intelligence (AI) & Machine Learning (ML) Experience:
- Hands-on exposure to AI-powered products including Large Language Model (LLM)-based systems.
- Experience working with model evaluation prompt or pipeline iteration and feedback loops.
- Strong intuition for model limitations hallucinations bias and drift.
Product Leadership:
- Significant experience owning complex technical products end-to-end.
- Proven ability to work closely with senior engineers and Machine Learning (ML) teams.
- Strong judgment and decision-making ability in ambiguous fast-moving environments.
- Ability to balance ambition with technical and operational reality.
Nice to have:
- Experience shipping AI-heavy consumer products.
- Background as an engineer or highly technical product manager.
- Experience defining evaluation metrics for Machine Learning (ML) systems.
- Strong intuition for Artificial Intelligence (AI) User Experience (UX) patterns and failure handling.
- Prior experience in zero-to-one product environments.
Benefits include medical insurance Dental Vision Savings Plan Options PTO etc.
Keywords: San Francisco CA Jobs AI Artificial Intelligence AI Agents Algorithms Backend Computer Science Fundamentals Data Structures LLM Large Language Model ML Machine Learning Senior Technical Product Manager System Design UX User Experience Work From Home Remote California Recruiters IT Jobs California Recruiting
Looking to hire a Senior Technical Product Manager in San Francisco CA or in other cities Our IT recruiting agencies and staffing companies can help.
We help companies that are looking to hire Senior Technical Product Managers for jobs in San Francisco California and in other cities too. Please contact our IT recruiting agencies and IT staffing companies today!
Additional Information :
All your information will be kept confidential according to EEO guidelines.
Remote Work :
Yes
Employment Type :
Full-time