Find Jobs in AI All opportunities
Open for applicationsCoding & data

Python Software Expert — AI Agent Safety Benchmarks

Open role
Pay
Contractor project · pay amount not provided
Location
Remote · Worldwide
Experience level
Experienced

A CLOSER LOOK

Explore the opportunity

01 / THE DETAILS

Role overview

Get to know the opportunity

Build coding-agent evaluations that measure useful task completion alongside safe handling of system constraints.

02 / THE DETAILS

What you’ll be doing

Your day-to-day contribution
  • Create production-like repository tasks, reference patches and runnable environments.
  • Develop tests for functionality, data integrity, privacy and permissions.
  • Analyse agent attempts and refine evaluation quality.
03 / THE DETAILS

Who this could suit

See where your experience could fit

Senior production-software engineers with practical secure-development experience.

04 / THE DETAILS

What you’ll need

Experience, skills and essential requirements
  • A relevant computer-science bachelor’s or master’s degree and at least eight years of software engineering are required.
  • Python is mandatory alongside another language such as Java, Go or C++.
  • You need production systems, observability, incident debugging, secure code review and validated remediation experience.

You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.

05 / THE DETAILS

Pay and working arrangements

Rates, commitment and working arrangements

Worldwide remote contractor assignment for four to eight weeks, without medical benefits or paid leave. At least four hours per day, 20 per week and four hours overlapping Pacific time are stated. No numeric pay is provided. The relative “next week” start needs confirmation.

06 / THE DETAILS

What happens next

How to move forward

Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps. Later review includes a profile check and a 45–60-minute delivery interview.

Practice for this role

Review a specialist conclusion

A quality report required checks on five samples. Four passed, and the fifth was not measured. The draft says “All five samples passed, so the batch meets the release rule.”

Explain what the evidence supports and what you would ask the team to check before release.

Sign in for private feedback or work through the example below.

See the rubric and example answer
  • Evidence · Four passed and the fifth has no recorded result.
  • Conclusion · The evidence does not establish that all five passed or that the release rule was met.
  • Follow-up · Measure and document the fifth sample before deciding.

Four samples passed. There is no result for the fifth, so the release rule has not been verified. Measure and document the fifth sample before deciding.

Application checklist
Requirements from the listing

A relevant computer-science bachelor’s or master’s degree and at least eight years of software engineering are required. Python is mandatory alongside another language such as Java, Go or C++. You need production systems, observability, incident debugging, secure code review and validated remediation experience.

Sign in to check your saved CV.

PayContractor project · pay amount not provided
Continue to apply