01 / THE DETAILSRole overview
Get to know the opportunity
Use C# or C++ experience to build or review realistic software engineering benchmark tasks.
02 / THE DETAILSWhat you’ll be doing
Your day-to-day contribution
- Triage issues in open-source repositories and configure reproducible development environments.
- Review unit-test coverage and run projects locally to assess AI-generated fixes.
- Work with researchers to select realistic repository issues and improve benchmark cases.
03 / THE DETAILSWho this could suit
See where your experience could fit
Experienced engineers who can navigate unfamiliar repositories, diagnose software issues and evaluate tests.
04 / THE DETAILSWhat you’ll need
Experience, skills and essential requirements
- The role asks for at least 3 years of software engineering, strong C# or C++ skills, Git, Docker and basic pipeline setup.
- You need to be comfortable running, modifying and testing existing software.
- Open-source or AI evaluation experience is helpful.
You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.
05 / THE DETAILSPay and working arrangements
Rates, commitment and working arrangements
Remote contractor work in Latin America for four weeks, at $25 per approved task. The commitment is at least 40 hours per week with four hours overlapping Pacific time. The listing also specifies at least four hours per day. Medical benefits and paid leave are excluded. The listing gave a start the following week relative to its posting date.
06 / THE DETAILSWhat happens next
How to move forward
Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps. The listing describes an assessment-based review of about 75 minutes.