Senior Analyst, Model Risk Management

Toast creates technology to help restaurants and local businesses succeed in a digital world helping business owners operate increase sales engage customers and keep employees happy. Toast is driven by building the restaurant platform that helps restaurants adapt take control and get back to what they do best: building the businesses they love. Now more than ever the Toast team is committed to our customers. Were taking steps to help restaurants navigate these unprecedented times with technology resources and community. Our focus is on building the restaurant platform that helps restaurants adapt take control and get back to what they do best: building the businesses they love. And because our technology is purpose-built for restaurants by restaurant people restaurants can trust thatwell deliver on their needs for today while investing in experiences that will power their restaurant of the future.

Bready* to make a change

As SeniorAnalyst in our Model Risk Management team you will help manage the Model Risk Program including completing model validation reviews maintaining the model risk inventory and monitoring model performance particularly for Fraud and Gen AI Models. You will work closely with the Data Science Team architects engineers and product managers to assess the risk of model design implementation and use across product lines.

A day in the life (Responsibilities)

• Support the implementation and day-to-day execution of the Second Line of Defense (2LOD) Model Risk Management (MRM) program for high-risk models with particular focus on Fraud detection models (Transaction Fraud & Merchant Fraud) and Generative AI / LLM-based systems deployed across Toast.
• Assist in maintaining and enhancing the Model Risk Management framework including policiesprocedures validation standards governance documentation templates and best practicesaligned with evolving regulatory and industry expectations.
• Enforce model lifecycle standards across development implementation use monitoringrecalibration change management governance and decommissioning ensuring appropriatecontrols for traditional ML models as well as GenAI systems (e.g. RAG architectures copilotsAI-assisted decision tools).
• Contribute to the development risk-tiering and ongoing maintenance of a comprehensive modelinventory including assessment of model impact intrinsic risk (complexity and methodology)reliance on model outputs and emerging AI-specific risks.
• Perform independent model validation reviews under the guidance of senior leadership coveringconceptual soundness data integrity model methodology performance metrics (e.g. AUCprecision/recall calibration) stability bias/fairness risk explainability and monitoringframeworks. Produce validation reports and track issue remediation plans through closure.
• For Fraud models evaluate class imbalance handling threshold optimization cost-sensitiveperformance metrics operational overlays rule-based controls and portfolio-level impactanalyses.
• For Generative AI systems validate systems and evaluate risks related to hallucination promptinjection adversarial vulnerabilities data privacy and leakage model explainability limitationsbias guardrails output monitoring jailbreak testing regression testing and human-in-the-loopcontrols.
• Partner with Data Science Data Engineering Product/Engineering Information SecurityLegal/Compliance Finance Credit Risk and Business teams to obtain documentation performeffective challenge conduct validation and oversee performance monitoring
• Prepare reports and executive materials summarizing model risk issues validation findingsmonitoring insights and remediation status for leadership review risk committees auditcommittees and internal audit engagements.
• Research and stay informed on industry developments in fraud analytics machine learningGenerative AI governance and regulatory guidance (e.g. SR 11-7 OCC 2011-12 NIST AI RMF).Propose enhancements to strengthen Toasts Model Risk and AI Governance framework.
• Contribute to the development of model risk training materials and support delivery of trainingsessions to key stakeholders to enhance awareness of fraud model risk and AI-related risks.
• Support ad-hoc initiatives related to model risk governance AI oversight regulatory complianceand enterprise risk management enhancements.

What youll need to thrive (Requirements)

• Advanced degree in Data Science Statistics Applied Mathematics Computer Science Engineering or a related quantitative discipline
• 5 years of relevant industry experience in Model Risk Management Model Validation DataScience or Machine Learning within fintech banking payments technology or consultingenvironments with exposure to fraud analytics credit risk or AI/ML model governance.
• Strong understanding of machine learning methodologies and statistical foundations includingmodel development validation techniques performance evaluation calibration and stabilityanalysis.
• Hands-on experience with fraud detection models (e.g. transaction monitoring chargebackprediction merchant risk scoring) and familiarity with concepts such as class imbalance handlingthreshold optimization precision/recall trade-offs and cost-sensitive evaluation.
• Familiarity with Generative AI and LLM-based systems (e.g. RAG architectures embeddingsprompt engineering AI copilots) and awareness of associated risks such as hallucination biasprompt injection and data leakage.
• Strong proficiency in Python and SQL; experience with data science and ML tools such as Sparkscikit-learn XGBoost LightGBM TensorFlow or PyTorch. Familiarity with software engineeringbest practices (version control CI/CD testing frameworks Airflow AWS or cloud platforms) is aplus.
• Knowledge of model risk management frameworks and regulatory guidance (e.g. SR 11-7 OCC2011-12) and familiarity with emerging AI governance frameworks (e.g. NIST AI RMF) is highlydesirable.
• Ability to translate complex quantitative methodologies into clear business insights andeffectively challenge first-line model development teams while maintaining strongcross-functional partnerships.
• Demonstrated critical thinking analytical rigor and structured problem-solving skills with theability to manage multiple priorities and deliver high-quality outputs under tight deadlines.
• Excellent written and verbal communication skills including experience drafting formalvalidation reports executive summaries and committee-level materials.

AI at Toast

At Toast one of our company values is that were hungry to build and learn. We believe learning new AI tools empowers us to build for our customers faster more independently and with higher quality. We provide these tools across all disciplines from Engineering and Product to Sales and Support and are inspired by how our Toasters are already driving real value with them. The people who thrive here are those who embrace changes that let us build more for our customers; its a core part of our culture.

Our Total Rewards Philosophy

We strive to provide competitive compensation and benefits programs that help to attract retain and motivate the best and brightest people in our industry. Our total rewards package goes beyond great earnings potential and provides the means to a healthy lifestyle with the flexibility to meet Toasters changing needs. Learn more about our benefits at Toast Uses AI in its Hiring Process

Throughout the hiring process our goal is to get to know you. We use AI tools to support our recruiters and interviewers with tasks like note-taking summarization and documentation of interviews to ensure they can be fully focused on your conversation. All hiring decisions are made by people.

Diversity Equity and Inclusion is Baked into our Recipe for Success

At Toast our employees are our secret ingredientwhen they thrive we restaurant industry is one of the most diverse and we embrace that diversity with authenticity inclusivity respect and humility. By embedding these principles into our culture and design we create equitable opportunities for all and raise the bar in delivering exceptional experiences.

We Thrive Together

We embrace a hybrid work model that fosters in-person collaboration while valuing individual needs. Our goal is to build a strong culture of connection as we work together to empower the restaurant community. To learn more about how we work globally and regionally check out: today!

Toast is committed to creating an accessible and inclusive hiring process. As part of this commitment we strive to provide reasonable accommodations for persons with disabilities to enable them to access the hiring process. If you need an accommodation to access the job application or interview process please contact .

------

For roles in the United States it is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.