01 / THE DETAILSRole overview
Get to know the opportunity
Build coding-agent evaluations that measure useful task completion alongside safe handling of system constraints.
02 / THE DETAILSWhat you’ll be doing
Your day-to-day contribution
- Create production-like repository tasks, reference patches and runnable environments.
- Develop tests for functionality, data integrity, privacy and permissions.
- Analyse agent attempts and refine evaluation quality.
03 / THE DETAILSWho this could suit
See where your experience could fit
Senior production-software engineers with practical secure-development experience.
04 / THE DETAILSWhat you’ll need
Experience, skills and essential requirements
- A relevant computer-science bachelor’s or master’s degree and at least eight years of software engineering are required.
- Python is mandatory alongside another language such as Java, Go or C++.
- You need production systems, observability, incident debugging, secure code review and validated remediation experience.
You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.
05 / THE DETAILSPay and working arrangements
Rates, commitment and working arrangements
Worldwide remote contractor assignment for four to eight weeks, without medical benefits or paid leave. At least four hours per day, 20 per week and four hours overlapping Pacific time are stated. No numeric pay is provided. The relative “next week” start needs confirmation.
06 / THE DETAILSWhat happens next
How to move forward
Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps. Later review includes a profile check and a 45–60-minute delivery interview.