SWE-Bench Task Auditor
- Pay: $70 to $90 / hour
- Contract: Contract
- Who can apply: United States
- Posted Aug 28, 2026
In short
Welcome to Simply Remotely! You can work from anywhere as a freelance SWE-Bench Task Auditor via Mercor, earning 70 to 90 USD per hour. This role suits you if you want to evaluate AI software tasks flexibly.
What you will do
- Assess software-engineering benchmark tasks
- Review reference patches and test harnesses
- Check grading integrity and security
- Write clear feedback using rubrics
What you need to apply
- 3+ years of professional software engineering
- Experience with open-source contributions
- Fluency in Python and other languages
- Ability to detect answer leakage
Who can apply
This freelance remote position is open to residents of US. There are 3 openings available.
My tip
At Simply Remotely, we advise you to highlight your open-source contributions clearly to stand out.