Rubric Academy Fellowship

Mercor is launching the Rubric Academy a specialized course designed to teach subject-matter experts how to rigorously evaluate Artificial Intelligence. To build models that can act as true professionals we need humans who can not only ask the right questions but also define exactly what a perfect answer looks like.

We are looking for professionals with unique domain knowledge to participate in a paid 35 hour instructional course. You will be paid to learn the methodology of Prompt-Rubric Pairingthe gold standard for training and benchmarking advanced AI models. Upon successful completion you will become eligible for our high-paying expert projects.

What You Will Learn

This is a paid upskilling opportunity. You will complete a seven-lesson interactive course followed by a practical capstone task designed to translate your standards of quality into machine-readable data:

• The Art of the Prompt: Learn to write inputs that set clear context clarity and constraints to elicit specific expert behaviors from an AI.

• The Golden Response: Learn how to define the ideal output. You will move beyond simple fact-checking to articulate the nuance tone and logic required for a top-tier professional response.

• Rubric Architecture: Learn to build objective grading systems. You will master writing Criterion Descriptions assigning weights and citing sources to create a mathematical framework for judging AI performance.

Who We Are Looking For

We are looking for deep domain experts in any field. Whether you are a legal scholar a structural engineer a clinical psychologist or a financial analystif you have standards for quality that are hard to quantify we want you.

• Deep Expertise: You possess unique knowledge that is difficult to find on the open web. You can cite specific sources (PDFs data sets) that support your professional judgments.

• Analytical Rigor: You are detail-oriented. You can break down a complex professional task into specific measurable steps (criteria) that an AI must follow.

• Integrity: You are committed to original work. You understand that using AI to grade AI defeats the purpose and you rely on your own knowledge and external verification.

Project Details & Compensation

• Stipend: Flat $50 to $150 payment upon successful completion of the Academy lessons and the Practice Task.

• Time Commitment: Approximately 35 hours (self-paced).

• Future Opportunities: Successful Graduates will be prioritized for our ongoing Expert Contributor roles (long-term projects creating training data for frontier models).

• Requirements: No paid subscriptions are required. You must be able to upload valid sources (PDF/CSV) to support your work.

Why Apply

• Get Paid to Upskill: Learn a highly technical skill set (Rubric Design and RLHF methodologies) that is essential for the next phase of AI development.

• Set the Standard: Your rubrics will serve as the ground truth for AI models teaching them the difference between a mediocre answer and an expert one.

• Unlock High-Value Work: This Academy is the required entry point for Mercors specialized high-hourly-rate expert projects.

Apply today to join the Rubric Academy and teach AI how to meet your professional standards.