AI Agent Evaluator
- Pay: $25 to $45 / hour
- Contract: Contract
- Who can apply: United States
- Posted Oct 9, 2026
In short
Do you want to test next-generation AI agents from your phone and earn 25 to 45 USD per hour? Simply Remotely brings you this freelance role via micro1 to evaluate how well AI handles daily tasks. It is ideal if you already use AI tools and want flexible remote work.
What you will do
- Run real-life scenarios like bills, shopping, and bookings using two AI agents
- Approve or stop the agent at key steps during each run
- Screen record every attempt and score the results
- Share clear written feedback on your experience
What you need to apply
- 2 to 3 years of experience, preferably in engineering, business management, or office/operations
- A Bachelor's degree and strong attention to detail
- An active personal AI account (Free, Go, or Plus) and a smartphone that can screen record
Who can apply
This freelance remote contract is open to residents of the US with 50 openings available.
My tip
At Simply Remotely, we advise you to be ready to complete screening questions and ensure your screen recording setup works before you apply.