Bilingual Evaluator Fully Remote
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.
Position: Dutch Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Duration: 36 months
Role Responsibilities
- Transcribe audio and video with precision in Dutch and English. Ensure adherence to multiple constraints and instructions.
- Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English.
- Conduct model testing by running prompts and assessing outputs against expectations.
- Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
- Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.
Qualifications
Must-Have
- Strong writing and critical thinking skills
- Ability to work independently and meet deadlines
- Fluent in Dutch and English
- Able to work within GMT or PST working hours
Preferred
- College students or graduates
Application Process (Takes 2030 mins to complete)
- Complete an AI-led interview (approximately 15 minutes)
- If selected you will be invited to work on the project
Resources & Support
- For details about the interview process and platform information please check:
- For any help or support reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
