01 / THE DETAILSRole overview
Get to know the opportunity
Turn real open-source software issues into reliable AI coding evaluations.
02 / THE DETAILSWhat you’ll be doing
Your day-to-day contribution
- Triage repository issues and run projects in Docker-based environments.
- Review test quality and evaluate AI bug fixes.
- Design benchmark cases and guide other engineers when required.
03 / THE DETAILSWho this could suit
See where your experience could fit
Experienced engineers who enjoy debugging unfamiliar codebases and assessing tests.
04 / THE DETAILSWhat you’ll need
Experience, skills and essential requirements
- At least five years of professional software engineering, strong Python and JavaScript, Git, Docker, basic CI knowledge and practical local testing/debugging are required.
- Clear technical communication and independent work matter.
You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.
05 / THE DETAILSPay and working arrangements
Rates, commitment and working arrangements
Remote contractor engagement for three months, at 40 hours per week with four daily hours overlapping Pacific time. No numeric compensation or payment schedule is supplied.
06 / THE DETAILSWhat happens next
How to move forward
Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps.