The Product Manager Specialist Generative AI will lead the evolution and scale of this AI-powered conversational experience. This role owns end-to-end for multiple domains from problem discovery and experimentation through pilot rollout and governance.
The Specialist will identify high-impact AI opportunities (domain) define strategy establish evaluation and monitoring frameworks and design human oversight mechanisms appropriate for a regulated financial environment. The role requires strong product fundamentals combined with a working knowledge of Generative AI principleslike LLMs SLMs conversational design evaluation techniques and AI safety considerations.
This individual treat trust safety and continuous learning as core product features not afterthoughts.
Core Responsibilities:
Strategic Product Leadership
1. Lead product management efforts across one or more strategic domains.
2. Identify and prioritize high-impact AI use cases that expand the AI assistants value to clients and internal stakeholders.
3. Work with senior product leadership along with peers leading other domain work to evolve its product vision roadmap and measurable success outcomes including quality trust adoption and business impact.
AI Product Lifecycle Management
4. Drive initiatives through discovery feasibility assessment experimentation pilot and scale.
5. Validate that Generative AI is the appropriate solution versus deterministic or rules-based approaches.
6. Define measurable quality bars and acceptance criteria for its outputs including accuracy completeness compliance explainability and latency.
Evaluation and Model Performance
7. Establish evaluations for your domain area including ground truth creation annotation strategies precision and recall trade-offs and continuous model monitoring.
8. Partner with data science and engineering to track model performance drift hallucinations confidence thresholds and flagged interactions.
9. Translate model behavior and evaluation results into actionable product decisions and iteration plans.
Human Oversight and Responsible AI
10. Continue to work with other product teams to manage human-in-the-loop systems including review workflows escalation paths and confidence gating.
11. Collaborate closely with Legal Compliance Risk and Data Governance to ensure appropriate disclosures guardrails and privacy controls are embedded from inception.
12. Define acceptable versus unacceptable use cases and ensure outputs align with enterprise standards for safety transparency and explainability.
UX and Conversational Experience
13. Partner with UX and prompt engineers to design this AI assistants conversational experience reducing ambiguity and supporting recovery from misunderstandings.
14. Balance accuracy latency and client trust in its conversational flows.
15. Leverage user feedback flagged conversations and behavioral metrics to continuously refine the AI assistants experience.
Cross-Functional Collaboration
16. Work closely with engineering data science UX legal compliance operations and business stakeholders to align on priorities and deliverables.
17. Translate strategy into clear requirements experiments and execution plans.
18. Participate in ongoing planning departmental prioritization activities and enterprise AI strategy discussions as required.
This AI assistant serves as the foundation for Vanguards broader AI-powered client experience strategy.
Qualifications:
5 years related work experience. 2 years ofleading large cross-functional teams on major organizational projects preferred.
Product Management experience utilizing GenAI
Preferences:
Undergraduate degree or equivalent combination of training and experience required. Graduate degree preferred.
Special Factors
Sponsorship
Vanguard is not offering visa sponsorship for this position.About Vanguard
At Vanguard we dont just have a missionwere on a mission.
To work for the long-term financial wellbeing of our clients. To lead through product and services that transform our clients lives. To learn and develop our skills as individuals and as a team. From Malvern to Melbourne our mission drives us forward and inspires us to be our best.
How We Work
Vanguard has implemented a hybrid working model for the majority of our crew members designed to capture the benefits of enhanced flexibility while enabling in-person learning collaboration and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.
Required Experience:
IC
Search the latest roles and opportunities at Vanguard. Apply today to join our industry-leading crew.