Clinical AI Evaluation Intern

Transform healthcare with us.

At Qualified Health were redefining whats possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI governance healthcare-specific agent creation and real-time algorithm monitoringworking alongside leading health systems to drive real change.

This is more than just a job. Its an opportunity to build the future of AI in healthcare solve complex challenges and make a lasting impact on patient care. If youre ambitious innovative and ready to move fast wed love to have you on board.

Join us in shaping the future of healthcare.

Job Summary:

Qualified Health is seeking a Medical Scribe Intern to join the clinical team responsible for reviewing evaluating and labeling the outputs of our GenAI products. Working alongside our physicians you will compare AI-generated clinical content against defined gold standards and label the data that trains and evaluates our models.

The ideal candidate has worked as a medical scribe or brings comparable clinical education or professional experience and is fluent in medical terminology and clinical documentation. This is a paid hourly internship. The work is structured and detail-intensive and the quality of our product depends on it being done carefully. You will be trained and mentored directly by our physicians who bring their clinical perspective to building products. Our physicians will review your work and give you direct feedback on it and your input will shape how this function is built as it grows.

This role is not patient-facing and does not accrue clinical contact hours. What it offers instead is a close look at how clinical AI is evaluated for safety before it reaches patient care. It is a chance to learn how these tools are tested and improved and to see firsthand how they are starting to change the way care is delivered.

Key Responsibilities:

• Complete structured quality assurance evaluation and labeling tasks on GenAI outputs following detailed written task instructions

• Review AI-generated clinical content for accuracy completeness and adherence to defined criteria documenting your reasoning clearly and consistently

• Apply consistent judgment across a high volume of work without drifting from the rubric

• Bring questions and blockers to the physician overseeing the work as they come up

• Handle protected health information in accordance with HIPAA and our clinical safety and privacy standards

Required Qualifications:

• 3 months of experience as a medical scribe or comparable medical educational or professional experience (for example: nursing PA or pre-med student; EMT CNA or medical assistant)

• Working fluency in medical terminology and clinical documentation and an understanding of how care is recorded in the chart

• Exceptional attention to detail and the ability to explain your reasoning clearly in writing

• Reliable consistent availability of 2040 hours per week (full time preferred) across a 6 month commitment

• Able to work onsite in Palo Alto 3 days/week

Desirable Skills and Experience:

• Familiarity with EHR systems (Epic Cerner) and clinical documentation workflows

• Experience with chart abstraction data labeling or annotation quality improvement or clinical research

• Interest in AI/ML in healthcare and in how clinical AI is evaluated for safety and accuracy

Why Join Qualified Health

You will be mentored by our physicians who bring their clinical training to building products that change how care is delivered. You will sit with the clinical team your findings will influence what ships and there is opportunity to extend beyond the initial 6 months. Our physicians are glad to write letters of recommendation for interns theyve worked closely with.

This is an opportunity to join a fast-growing company and a world-class team that is poised to change the healthcare industry. We are a passionate mission-driven team that is building a category-defining product and we are backed by premier investors.

Our employees are integral to achieving our goals so we are proud to offer competitive pay flexible working hours hybrid work options and an inclusive environment that fosters creativity and innovation.

Our Commitment to Diversity

Qualified Health is an equal opportunity employer. We believe that a diverse and inclusive workplace is essential to our success and we are committed to building a team that reflects the world we live in. We encourage applications from all qualified individuals regardless of race color religion gender sexual orientation gender identity or expression age national origin marital status disability or veteran status.

Pay & Details:

This is a paid hourly internship beginning in September 2026 at $40.00 per hour. The role runs for 6 months at 2040 hours per week with full time preferred and may be extended based on performance and team needs.

Join our mission to revolutionize healthcare with AI. To apply please send your resume through the application below.

Required Experience:

Intern