Enter a job title or keyword

AI Model Policy Trainer, Image Evaluation Seattle Onsite

Handshake


Job Location:

Seattle, WA - USA

Hourly Salary: USD 36 - 72
Posted: 29 September 2026 (Yesterday)
Application Deadline: 27 December 2026
Vacancies: 1 Vacancy

Job Summary

About Handshake

Handshake was founded on a simple belief that everyone deserves a path to a great career regardless of where they went to school or who they know. Today we power 25 million job seekers 1 million employers and 1600 educational institutions.

Handshake AI works directly with frontier AI lab researchers to create evaluations publish benchmarks and improve AI models through human expertise.

Role Details

Location: Onsite in Seattle WA Monday-Friday.

Compensation: $36-$72/hr. Placement within the range depends on experience.

Employer: TCWGlobal. This is a W-2 assignment supporting Handshake AI.

Employment: Full time 40 hours per week non-exempt and eligible for overtime pay.

Schedule: Monday-Friday 8 a.m.-5 p.m. PT.

About the Role

As an AI Image Evaluator you will help image generation models learn two things at once: what a good image is and what an acceptable image is.

You will look at prompts and the images a model produced from them then answer questions like: Did the image do what the prompt asked Is it well made or does it have the hands lighting text and anatomy problems that give generated images away Which of two images is better and why Does the image violate the customers content policy and if so which category and how severely Does it depict a real person a protected brand or a minor in a way the policy does not allow

The interesting cases are the close ones. Two images that look nearly identical until you notice one has a logo in the background. A stylized nude that is fine as figure study and not fine with one change of pose. A prompt that asked for a realistic photo of a senator and a model that complied. A beautiful image that ignored half the prompt next to an ugly one that nailed it.

We are looking for people who already see images critically whether that came from photography illustration design years inside Midjourney and Stable Diffusion or moderating visual content at scale. You do not need all of these. You need one deep and the judgment to learn the rest.

This is not rote annotation. Rubrics cannot anticipate every image and good evaluators do not apply them mechanically. You will balance the rubrics text and intent with customer expectations precedent and team calibration and you will explain your reasoning clearly enough that it can train a model.

What You Will Do
  • Evaluate generated images against their prompts for adherence composition realism style consistency and technical defects; maintain accuracy and consistency across repeated evaluations

  • Compare images side by side and select the stronger one with a clear evidence-based rationale

  • Classify images against customer content policies covering sexual content violence hate symbols real-person likeness intellectual property and depictions of minors

  • Select the most defensible classification when an image is genuinely ambiguous and write concise rationales that cite rubric language and specific visual details

  • Distinguish I do not like this from this fails the prompt from this violates policy and keep those judgments separate while applying customer policy consistently

  • Write and refine prompts that probe where a models quality or safety behavior breaks down

  • Identify rubric gaps contradictions and emerging edge cases and raise them with project leads and policy teams

  • Participate actively in calibration discussions; challenge interpretations respectfully and update your judgment when stronger reasoning emerges

You May Be a Fit If
  • You have a trained eye from photography illustration concept art art direction retouching photo editing VFX or visual design and you can say precisely why one image is better than another

  • You use generative image tools heavily (Midjourney Stable Diffusion ComfyUI Flux DALL-E Ideogram) and know their failure modes their prompt quirks and how their safety filters get bypassed

  • You have moderated or reviewed visual content at scale and have applied a policy taxonomy to borderline images under time pressure

  • You notice small details: an extra finger a mismatched shadow a brand mark a face that is a little too familiar

  • You can hold a rubric steady across a long session of near-identical images and treat sensitive material with maturity and sound judgment

  • You can hold a strong opinion without becoming attached to being right

  • You explain judgment calls clearly and precisely in writing so another person can audit your reasoning

  • You can separate your personal taste from the standard a customer has asked you to apply

Strong candidates may come from photography illustration graphic or UX design art direction photo editing animation or VFX game art trust and safety content moderation brand or IP enforcement ad review or art education. We care more about how you see and how you reason than where you learned to do it. A degree and a technical background are not required.

Nice to Have
  • A public portfolio publication credits or a body of generative work (Civitai Discord communities LoRA or model training published prompt work)

  • Experience judging images comparatively: portfolio review photo competition judging creative A/B testing art school critique

  • Formal training in anatomy color lighting or composition

  • Content moderation or trust and safety experience on an image-heavy platform

  • Working knowledge of copyright trademark and right-of-publicity basics

  • Prior work in AI evaluation RLHF image labeling or data annotation

  • Familiarity with calibration sessions inter-rater agreement or adjudication workflows

Sensitive-Content Notice

This role involves regular and deliberate engagement with sensitive imagery. Depending on the project evaluations may include sexual content and nudity graphic violence and gore hate symbols self-harm and depictions of real people and of minors in contexts that must be assessed against policy. Some of this material is disturbing by design because the purpose of the work is to teach models not to produce it.

The work is conducted within structured evaluation frameworks and professional guidelines with exposure limits content rotation mandatory reporting protocols for illegal material and access to mental health support. Candidates must be able to engage with this material carefully responsibly and sustainably while maintaining sound judgment and consistent work quality.

Benefits

Benefits are provided through TCWGlobal. Eligible employees can enroll in medical coverage including prescription and mental health benefits dental and vision insurance healthcare and dependent care flexible spending accounts and pretax commuter benefits. A 401(k) retirement plan with an employer match is available to eligible participants.

Additional offerings include voluntary accident critical illness and term life insurance wellness and pet-related reimbursements charitable matching and employee discounts. Eligibility requirements waiting periods employee contributions and plan terms apply.

Full-time employees scheduled for at least 30 hours per week are eligible for health coverage beginning the first of the month following at least 30 days of employment. Retirement plan eligibility follows a separate schedule.

Paid time off: PTO accrues from the first day of the assignment at one hour per 40 hours worked with no waiting period to use accrued PTO. PTO may be used for vacation personal days or illness subject to policy approval requirements. Accrual is capped at 80 hours per year and balances at 100 hours unless otherwise required by law. Additional paid sick leave is provided in accordance with applicable Washington and Seattle requirements.

Paid holidays: The holiday policy lists 13 paid holidays. Eligible employees receive eight hours of holiday pay at their base hourly rate for observed holidays that fall on a scheduled workday subject to the holiday policy.

See the TCWGlobal 2026 Benefits Guide for coverage options costs and enrollment details.

Interview Process

The process includes application review a recruiter screen a skills assessment a hiring manager screen onsite interviews and a final round before the offer stage. Your recruiter will share the next steps as you move through the process.

Equal Opportunity and Accommodations

TCWGlobal is an equal opportunity employer. Hiring decisions are based on qualifications and abilities without discrimination based on characteristics protected by applicable law.

Reasonable accommodations are available during the application and interview process. If you need an accommodation please let your recruiter know.


Required Experience:

IC


About Company

Company Logo

The better career platform for Gen Z changing how, where, and why the next generation of talent builds their career.

View Profile View Profile