AI Agent Tester Real-World Tasks Remote

Role Type: Contractor
Location: United States

We are seeking detail-oriented U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. You will test two AI agents using your own accounts and smartphone assess their performance and provide feedback to improve their real-world usability.

1. Test AI agents on tasks such as shopping bookings bill payments returns email follow-ups travel and online forms.
2. Approve or stop agents at important decision points.
3. Screen-record every task attempt.
4. Score performance based on completion quality user control satisfaction and time.
5. Provide clear written feedback on the overall user experience.

1. Must be based in the United States.
2. Bachelors degree required.
3. 23 years of professional experience preferably in engineering business management or operations.
4. Regular use of AI tools in daily life.
5. Strong attention to detail written communication and documentation skills.
6. An active personal AI assistant account (Plus tier) active Muse and Dots access a smartphone with screen-recording capability and a payment card for reimbursable test purchases.

No coding or AI technical background is required. Generalists are welcome and domain experts are preferred.

• Kickoff: Project is already active.
• Onboarding: Within 2448 hours of selection.
• Work Schedule: Flexible entirely from your phone.
• Task Duration: Approximately 1.5 hours per run including evidence and scoring.

1. Apply and complete the screening questions.
2. Attend a 1530-minute interview.
3. Complete the profile review.
4. Receive onboarding instructions from the Talent Operations team.

• Work with AI tools and evaluate real-world performance.
• Enjoy flexible phone-based work.
• Help shape and improve next-generation AI agents.