AI Agentic Workflow Reviewer

Innodata(Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably mission is to enable the responsible advancement of artificial intelligence by providing the data evaluation frameworks and human expertise required to build AI systems that can be trusted at provide a range of transferable solutions platforms and services for Generative AI / AI builders and every relationship we honor our 36 year legacy delivering the highest quality data and outstanding outcomes for our customers.

Scope of the Role:

Were building a dedicated reviewer team to evaluate complex real-world agentic AI workflows assessing whether AI agents complete tasks safely respect user intent and consent and hold up under close scrutiny. This isnt routine content moderation: reviewers work through ambiguous multi-step scenarios where judgment calls matter as much as checklists. Youll operate inside isolated test environments apply structured rubrics and help calibrate what safe and policy adherent agent behavior actually looks like.

What Youll Own:

• Review multi-step agent task trajectories against rubric-based criteria covering task success safety and policy adherence
• Evaluate whether an agent respected user agency and informed consent not just whether it followed literal instructions
• Apply privacy guardrails when reviewing tasks involving sensitive or personal data
• Work inside isolated test environments including verifying environment resets between test runs to prevent cross-contamination
• Flag and escalate safety-relevant or ambiguous findings through defined escalation paths

Youll Thrive in This Role If You Have:

• Bachelors degree or equivalent practical experience
• 25 years in quality review QA/QC trust & safety content moderation data annotation or a similarly judgment-intensive review role
• Strong written communication you can justify a scoring decision clearly enough for someone else to audit it
• Comfort with ambiguity and structured decision-making under a rubric rather than needing a fixed rulebook for every case
  
• Baseline understanding of AI/ML concepts and how AI agents complete tasks (can be learned through onboarding but some familiarity helps)

The expected hourly salary range for this position is $50-$55p/hour based on experience skills and qualifications.

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment banking details or sensitive personal information during the application process. To learn more on how to recognize job scams please visit the Federal Trade Commissions guide at you believe youve been targeted by a recruitment scam please report it to Innodata atand consider reporting it to the FTC at.