Audio Evaluation Expert Linguistics

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: English (US) Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Commitment: 1020 hours/week

Role Responsibilities

• Transcribe and optimize audio and video content in English (US) ensuring clarity and accuracy.
• Develop and document evaluation standards including rubrics and grading guidelines in English.
• Conduct model testing and grading providing structured feedback to improve AI model performance.
• Support benchmarking and quality assurance to maintain consistency and reliability.
• Collaborate with project leads to resolve ambiguities and improve task design.

Qualifications

Must-Have

• Strong writing editing and critical thinking skills.
• Ability to work independently and manage time effectively.
• Native or near-native fluency in English (US).
• Familiarity with American English spoken language and regional vocabulary.
• Ability to transcribe and analyze English audio content.
• Available to commit 1020 hours per week.

Preferred

• College students or recent graduates.
• Background in linguistics humanities social sciences journalism translation/localization or technical disciplines.
• Experience with transcription annotation localization evaluation or research workflows in English.
• Familiarity with regional dialects and variations of American English.
• Interest in AI language models or applied research environments.

Application Process (Takes 2030 mins to complete)

• Complete a short AI-led interview (approximately 15 minutes).
• If selected you will be onboarded and invited to begin project work.

Resources & Support

• For details about the interview process and platform information please check:
• For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.