Audio Evaluator AI Trainer

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: English (New Zealand) Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Commitment: 1020 hours/week

Role Responsibilities

• Transcribe and optimize audio and video content in English (New Zealand) ensuring clarity and adherence to guidelines.
• Develop and document evaluation standards including rubrics and grading guidelines in English.
• Conduct model testing and grading providing feedback to improve model performance in New Zealand English audio tasks.
• Support benchmarking and quality assurance to maintain consistency and reliability in datasets.
• Collaborate with project leads to resolve ambiguities and enhance task design.

Qualifications

Must-Have

• Strong writing editing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Native or near-native fluency in English (New Zealand).
• Familiarity with New Zealand English regional vocabulary and Māori influences.
• Available to commit 1020 hours/week.

Preferred

• College students or recent graduates.
• Background in linguistics humanities or social sciences.
• Experience with transcription annotation or localization.
• Interest in AI and language models.

Application Process (Takes 2030 mins to complete)

• Complete a short AI-led interview (approximately 15 minutes).
• If selected you will be onboarded and invited to begin project work.

Resources & Support

• For details about the interview process and platform information please check:
• For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.