Electrical Engineering Specialist

San Francisco, CA - USA

Monthly Salary: Not Disclosed

Posted on: 2 hours ago

Vacancies: 1 Vacancy

Job Summary

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: Engineering AI Evaluator
Type: Contract
Compensation: $73/hour
Location: Remote

Role Responsibilities

Write and refine prompts to guide model behavior in engineering scenarios.
Evaluate LLM-generated responses for technical accuracy and applied reasoning.
Conduct fact-checking and verify technical claims using authoritative sources.
Annotate model responses identifying strengths and areas for improvement.
Assess clarity and appropriateness of explanations for different audiences.
Ensure model responses align with expected conversational behavior and guidelines.

Qualifications

Must-Have

PhD in Engineering or a closely related field
Expertise in Mechanical & Physical Systems Engineering Electrical Electronic & Computer Engineering Chemical Materials & Process Engineering or Civil Environmental & Infrastructure Engineering
Significant experience using large language models (LLMs)
Excellent writing skills
Strong attention to detail
Experience reviewing or editing technical or academic writing

Preferred

Experience with applied research industry engineering workflows or systems design
Prior experience with RLHF model evaluation or data annotation work
Experience teaching or explaining engineering concepts to non-expert audiences
Familiarity with evaluation rubrics or structured review frameworks

Application Process (Takes 2030 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information please check:
For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey. Position: Engineering AI Evaluator Type: Contract Compensation: $73...