Let's begin! VP-Senior Analyst (Artificial Intelligence Model Risk and Evaluation)
Share
Job Location:
Monthly Salary:
Posted on:
18 hours ago
Vacancies:
1 Vacancy
Job Summary
At Moodys we unite the brightest minds to turn todays risks into tomorrows opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they arewith the freedom to exchange ideas think innovatively and listen to each other and customers in meaningful ways. Moodys is transforming how the world sees risk. As a global leader in ratings and integrated risk assessment were advancing AI to move from insight to actionenabling intelligence that not only understands complexity but responds to it. We decode risk to unlock opportunity helping our clients navigate uncertainty with clarity speed and confidence.
If you are excited about this opportunity but do not meet every single requirement please apply! You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship lead with curiosity champion diverse perspectives turn inputs into actions and uphold trust through integrity.
Skills & Competencies
- Overall 12 years of experience with 7 years experience in machine learning with strong expertise in GenAI agentic AI and associated risk and evaluation frameworks
- Skilled in NLP prompt engineering RAG cloud deployment and programming (Python )
- Strong analytical and problemsolving abilities with experience reviewing complex processes
- Excellent communication skills able to engage technical and non-technical stakeholders across global crossfunctional teams
- Experience leading large-scale projects; able to work independently prioritize multitask and adapt quickly
- Knowledge of cloud services (AWS/Azure) and prior experience in corporate finance or debt markets preferred
Education
- Masters or Bachelors degree in data science computer science statistics mathematics or similar quantitative disciplines
Responsibilities
The VP-Senior Analyst leads independent validation evaluation and governance of advanced AI systems including Machine Learning Generative AI (GenAI) and Agentic AI models. This role is central to ensure use of AI in Moodys Ratings is robust reliable and compliant with governance and regulatory standards
- Lead and mentor a small team responsible for evaluating and validating AI and machine learning models
- Design and execute robust evaluation frameworks for GenAI Agentic AI and traditional ML models including prompt engineering and model benchmarking
- Develop and run systematic model evaluations to benchmark performance and safety leveraging industry leaderboards subject matter expert (SME) reviews and LLM as a judge methodologies
- Independently test and validate ML models in line with best practices including conceptual soundness implementation integrity and performance assessment
- Assess and manage AI system risks with a focus on accuracy bias explainability robustness and operational integrity
- Collaborate cross functionally with technology risk compliance and business stakeholders to ensure alignment with governance frameworks and regulatory standards
- Communicate complex validation findings and recommendations clearly to both technical and non technical audiences
- Maintain high standards of documentation and reporting supporting transparency auditability and continuous improvement in model risk management processes
- Apply advanced quantitative and analytical skills with experience in financial credit or equity analysis
- Leverage statistical techniques and software tools to analyze model outputs and evaluate performance distributions
- Demonstrate strong communication and documentation capabilities including drafting requirements technical documentation and user guides
- Exhibit deep proficiency in AI and LLM technologies with hands on experience evaluating LLM applications strong awareness of AI risk management and a commitment to responsible AI use
About the team
Digital Economy team at Moodys Ratings focuses on assessing and managing risks emerging from digital finance artificial intelligence and cyber threats which are reshaping global financial systems and credit markets. The team provides thought leadership and analytical insights into how technologies like blockchain AI and digital assets impact operational resilience.
Moodys is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race color religion sex national origin disability protected veteran status sexual orientation gender expression gender identity or any other characteristic protected by law.
Candidates for Moodys Corporation may be asked to disclose securities holdings pursuant to Moodys Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy including remediation of positions in those holdings as necessary.
Required Experience:
Exec
Key Skills
- All-Source Intelligence
- Military Intelligence
- GIS
- ICD Coding
- Intelligence Experience
- Military Experience
- Analysis Skills
- Microsoft Powerpoint
- Joint Operations
- Intelligence Analysis
- Leadership Experience
- Writing Skills
About Company
Moody's CreditView is our flagship solution for global capital markets that incorporates credit ratings, research and data from Moody's Investors Service plus research, data and content from Moody's Analytics.
