Let's begin! Vice President Data Science (AI Model Risk and Evaluation)
Share
Job Location:
Buenos Aires - Argentina
Monthly Salary:
Not Disclosed
Posted on:
12 hours ago
Vacancies:
1 Vacancy
Job Summary
At Moodys we unite the brightest minds to turn todays risks into tomorrows opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they arewith the freedom to exchange ideas think innovatively and listen to each other and customers in meaningful ways. Moodys is transforming how the world sees risk. As a global leader in ratings and integrated risk assessment were advancing AI to move from insight to actionenabling intelligence that not only understands complexity but responds to it. We decode risk to unlock opportunity helping our clients navigate uncertainty with clarity speed and confidence.
If you are excited about this opportunity but do not meet every single requirement please apply! You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship lead with curiosity champion diverse perspectives turn inputs into actions and uphold trust through integrity.
Skills and Competencies
- 7 years in machine learning with deep understanding of GenAI and Agentic AI risks and evaluation frameworks
- Experience with NLP prompt engineering RAG agentic AI and cloud deployment preferred
- Comfortable with programming in multiple languages such as Python
- Excellent communication skills for technical and non-technical audiences.
- Previous experience in corporate finance or debt markets is preferred.
- Excellent knowledge of cloud services. Experience with AWS and/or Microsoft Azure is a plus
- Clear Thinker with strong analytical skills to review complex processes.
- Effective communication skills both verbal and written.
- Ability to work independently with or without direction and/or supervision.
- Demonstrated ability to effectively interface with a diverse global and cross-functional team and led large-scale projects.
- Ability to prioritize and multitask flexibility and adaptability in work approach.
Education
- Masters or bachelors degrees in data science computer science statistics mathematics or similar quantitative disciplines are required.
Responsibilities
The VP-Data Science leads independent validation evaluation and governance of advanced AI systems including Machine Learning Generative AI (GenAI) and Agentic AI models. This role is central to ensure use of AI in Moodys Ratings is robust reliable and compliant with governance and regulatory standards.
- Lead and mentor small team in the evaluation and validation of AI and Machine Learning models.
- Design and execute evaluation frameworks for GenAI Agentic AI and machine learning models including prompt engineering and model benchmarking.
- Develop and run systematic model evaluations to benchmark performance and safety leveraging industry leaderboards SME review and LLM-as-a-judge frameworks.
- Independently test and validate ML models following best practices such as conceptual soundness implementation integrity and model performance.
- Assess risks in AI systems focusing on accuracy bias explainability and operational integrity.
- Collaborate with technology risk compliance and business stakeholders to ensure alignment with governance and regulatory standards.
- Communicate complex validation results and recommendations to both technical and non-technical audiences.
- Maintain high standards of documentation reporting and continuous improvement in model risk management processes.
- Advanced quantitative and analytical skills with experience in financial credit or equity analysis
- Hands-on and proficient in developing software tools and models to evaluate performance of AI systems
- Skilled in using statistical distributions to analyze model outputs and use various software applications
- Excellent communication and documentation skills including drafting requirements and user guides
- Demonstrated proficiency in AI concepts with hands-on experience using AI tools to run evaluation and testing of LLM based applications
- Experience leading small teams in the evaluation and validation of AI and machine learning models.
- Demonstrates strong awareness of AI risk management and a commitment to responsible AI use
About the team
Digital Economy team at Moodys Ratings focuses on assessing and managing risks emerging from digital finance artificial intelligence and cyber threats which are reshaping global financial systems and credit markets. The team provides thought leadership and analytical insights into how technologies like blockchain AI and digital assets impact operational resilience.
Moodys is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race color religion sex national origin disability protected veteran status sexual orientation gender expression gender identity or any other characteristic protected by law.
Candidates for Moodys Corporation may be asked to disclose securities holdings pursuant to Moodys Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy including remediation of positions in those holdings as necessary.
Required Experience:
Exec
Key Skills
- Change Management
- Financial Services
- Growing Experience
- Managed Care
- Management Experience
- Analysis Skills
- Senior Leadership
- Performance Management
- Process Management
- Leadership Experience
- negotiation
- Analytics
About Company
Moody's CreditView is our flagship solution for global capital markets that incorporates credit ratings, research and data from Moody's Investors Service plus research, data and content from Moody's Analytics.
