What you will do
Leadership & Management
Lead manage and mentor a high-performing team of data scientists and reviewers providing expert oversight for both Generative AI application review and rigorous model validation projects.
Oversee the execution of multiple complex validation projects simultaneously from test design to final delivery and communication.
Serve as the primary technical lead for validating GenAI safety. Direct team members in identifying and mitigating complex risks such as model hallucinations prompt injection and data leakage.
Foster a culture of critical thinking continuous improvement and effective risk management within the team.
Collaborate with global partners to supervise validation projects ensuring a consistent and technically sound approach to AI/Model Risk Management across non-direct reporting lines
Technical Validation & Research
Lead and perform independent deep-dive validations of complex models focusing on the end-to-end design implementation and performance of Generative AI applications alongside traditional statistical models.
Conduct deep-dive research into emerging analytical techniques and LLM-as-a-judge evaluation methods to stay ahead of the curve in validating Agentic AI and other non-deterministic systems.
Develop and execute comprehensive validation test designs to assess model soundness and identify potential risks.
Critically assess the completeness and accuracy of model documentation code and marketing materials.
Develop and implement innovative validation approaches for complex and nontraditional models including those with unstructured data and unique risk profiles.
Governance & Collaboration
Serve as a trusted advisor to model developers engineers and business owners providing expert guidance on model design development and AI safety-by-design.
Review and provide guidance on model monitoring plans and ongoing performance reports.
Drive the enhancement of Model Risk Management procedures and standards to align with evolving regulatory requirements and industry best practices
Collaborate with key stakeholders across the organization including marketing technology legal compliance and business owners to ensure a robust model risk governance framework.
Respond to and manage inquiries from clients internal auditors and regulators regarding model risk matters.
Required Experience:
Exec
VetJobs & Military Spouse Jobs works with our employer partners to source, screen, and move qualified talent to the desktops of the Hiring Managers. Application is a two-step process, so please be patient with the team. When you submit to a position on our site your information will ... View more