Linguist Rater Guidelines Specialist
San Francisco, CA - USA
Job Summary
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.
Position: AI Rater Guidelines Writer (Linguist / Instructional Designer)
Type: Contract
Compensation: $45$65/hour
Location: Remote
Role Responsibilities
- Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across various domains.
- Design clear non-contradictory rating guidelines and rubrics for consistent application by raters including in edge cases.
- Evaluate draft guidelines for ambiguity contradictions and coverage gaps revising until raters can apply them without escalation.
- Translate program specifications from domains such as finance retail insurance legal and sports into precise rater instructions.
- Collaborate with subject matter experts and program leads to ensure consistency and accuracy across guideline sets.
Qualifications
Must-Have
- 3 years of professional experience in linguistics instructional design technical writing or a related field.
- Experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
- Ability to work across multiple domains (e.g. finance retail insurance legal sports) and translate domain-specific nuances.
- Strong track record of resolving ambiguity and contradiction in written specifications.
- Ability to engage reliably for at least 35 hours/week during weekdays.
- Strong written communication skills for explaining complex guidance clearly.
Application Process (Takes 2030 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information please check:
- For any help or support reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.