Medical Evaluation Specialist
Job Summary
IMPORTANT: after you apply please check your email. We send you a link to complete your application it is not considered until that last step is done. If you do not see it check your spam folder.
This is a fully remote position open to candidates based in Canada.
Pay: $40$90/hr
Role Title: Medical Evaluation Specialist (students residents physicians)
Role Type: Contractor
Location: Remote
We are engaging Medical Evaluation Specialists (students residents physicians) to contribute advanced clinical insights to a cutting-edge customer this role youll apply your expertise to help train next-generation AI systems. Your work will shape how models learn reason and perform through high-quality real-world input. No prior experience in AI is required your domain knowledge is what matters. As a contributor you will design and verify high-quality challenging medical questions and answers that probe the depth and reliability of todays frontier AI focusing on the places where nuanced medical reasoning makes the difference.
Scope of Work
- Craft original high-difficulty medical question-and-answer pairs covering diagnosis mechanisms pharmacology guidelines and clinical judgment.
- Source and verify answers using primary literature clinical guidelines and authoritative references; thoroughly document rationale and citations.
- Develop questions requiring synthesis and genuine clinical reasoning rather than simple fact recall.
- Evaluate AI model responses to your questions refine those that are too straightforward and enhance complexity while ensuring clinical accuracy.
- Ensure all questions and answers are written with clarity precision and defensibility avoiding ambiguity.
- Incorporate reviewer feedback and align deliverables with evolving project guidelines and standards.
Preferred Qualifications
- Current medical training or clinical practice as a student resident or physician or equivalent biomedical expertise.
- Demonstrated ability to locate interpret and synthesize information from primary literature and clinical guidelines.
- Exceptional attention to detail and proficiency in written English (native fluency not required).
- Talent for creating engaging well-structured and clinically nuanced questions.
- Self-motivated and reliable in managing independent remote contributions.
- Experience with medical question writing peer review or evaluative projects is an advantage.
- Familiarity with AI/ML systems or model evaluation is a plus but not essential.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the experts experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected we expect you to start your first tasks within 2448 hours of completing onboarding.
How to apply
Apply here with your profile. We will then email you a link to complete your application on the hiring platform your application is only considered once that final step is done.