Machine Learning Engineer
Boca Raton, FL - USA
Job Summary
Join the Team Modernizing Medicine
AtModMed were not just building softwarewere reimagining the healthcare experience. Founded in 2010 by a practicing physician and a successful tech entrepreneur we took a radically different approach:we hired doctors and taught them how to code.This for doctors by doctors philosophy has allowed us to create an AI-enabled specialty-specific cloud platform that places patients at the center of care.
A Culture of Excellence
When you join ModMed youre joining an award-winning team recognized for innovation and employee satisfaction. From our global headquarters in Boca Raton Florida and extensive employee base in Hyderabad India we are a team of 4500 passionate problem-solvers on a mission to increase medical practice success and improve patient outcomes:
Consistently ranked as a Top Place to Work
2025 Globee Business Awards:Gold Globee for Technology Team of the Year
2025 Black Book Awards:Ranked #1 EHR in 11 Specialties
Florida Venture Forum:Venture-Backed Company of the Year
We are growing fast thinking big and we are just getting started.
Ready to modernize medicine with us
Job Description Summary:
We are seeking a Machine Learning Engineer to build the active brain of our patient engagement this role you will develop autonomous and conversational AI agents capable of triaging patient messages and managing clinical workflows.
Your mission is to design systems that dont just respond but actexecuting complex tasks with minimal human intervention while maintaining high standards of safety empathy and accuracy.
What youll do
Autonomous Agent Development
Design and deploy multi-agent systems using frameworks such as LangGraph AutoGen CrewAI or no-code/low-code agent frameworks to execute complex non-linear clinical workflows.Patient Engagement Agents
Build and optimize conversational AI interfaces that handle message triage sentiment analysis and context-aware responses that are natural empathetic and patient-centric. Develop tool-calling architectures that enable AI agents to interact with external APIs EHR systems and databases to perform real-world actions.Model & Agent Evaluation
Design and implement evaluation frameworks to measure model and agent performance including accuracy reliability safety and task completion. Continuously improve systems using structured evaluation methodologies and feedback loops.Safety & Guardrails
Implement robust evaluation pipelines and guardrails (e.g. NeMo Guardrails) to ensure agent safety clinical accuracy and HIPAA compliance.AI Observability
Create and maintain dashboards to monitor agent reasoning traces system performance uptime and task completion rates in production environments.
What youll bring
3 years of experience in Machine Learning with a strong focus on AI agents and conversational NLP systems.
Proven experience building autonomous systems using LangGraph AutoGen CrewAI or similar no-code/low-code agent frameworks.
Hands-on experience with fine-tuning models and implementing rigorous evaluation frameworks to ensure agent performance safety and reliability. Familiarity with techniques for detecting hallucinations bias and failure modes in agent behavior.
Strong understanding of guardrails alignment techniques and safety mechanisms to ensure compliant accurate and trustworthy agent outputs in sensitive environments.
Hands-on experience with AWS and Databricks including building CI/CD pipelines for deploying machine learning models and AI agents.
Strong proficiency in Python and experience with modern evaluation frameworks such as RAGAS or DeepEval.
ModMed Benefits Highlight: At ModMed we believe its important to offer a competitive benefits package designed to meet the diverse needs of our growing workforce. Eligible Modernizers can enroll in a wide range of benefits:
United States
- Comprehensive medical dental and vision benefits including a company Health Savings Account contribution
- 401(k): ModMed provides a matching contribution each payday of 50% of your contribution deferred on up to 6% of your compensation. After one year of employment with ModMed 100% of any matching contribution you receive is yours to keep.
- Generous Paid Time Off and Paid Parental Leave programs
- Company paid Life and Disability benefits Flexible Spending Account and Employee Assistance Programs
- Company-sponsored Business Resource & Special Interest Groups that provide engaged and supportive communities within ModMed
- Professional development opportunities including tuition reimbursement programs and unlimited access to LinkedIn Learning
- Global presence and in-person collaboration opportunities; dog-friendly HQ (US) Hybrid office-based roles and remote availability for some roles
- Weekly catered breakfast and lunch treadmill workstations Zen and wellness rooms within our BRIC headquarters.
PHISHING SCAM WARNING: ModMed is among several companies recently made aware of a phishing scam involving imposters posing as hiring managers recruiting via email text and social media. The imposters are creating misleading email accounts conducting remote interviews and making fake job offers in order to collect personal and financial information from unsuspecting individuals. Please be aware that no job offers will be made from ModMed without a formal interview process and valid communications from our hiring team will come from our employees with a ModMed email address (). Please check senders email addresses carefully. Additionally ModMed will not ask you to purchase equipment or supplies as part of your onboarding process. If you are receiving communications as described above please report them to the FTC website.
Required Experience:
IC
About Company
Improve efficiency and treatment outcomes with Modernizing Medicine's specialty-specific EHR systems and healthcare suites built by specialty physicians.