01 / THE DETAILSRole overview
Get to know the opportunity
Evaluate and improve AI agents used in enterprise workflows, turning failures observed in practice into targeted experiments and more reliable systems.
02 / THE DETAILSWhat you’ll be doing
Your day-to-day contribution
- Build agent benchmarks, evaluation datasets and metrics for tool use and multi-step workflows.
- Investigate production failures and run experiments to test fixes and measure reliability.
- Develop Python evaluation pipelines and research tools, working with researchers, domain experts and customers.
03 / THE DETAILSWho this could suit
See where your experience could fit
Applied AI researchers and research engineers who enjoy translating practical customer problems into structured technical experiments.
04 / THE DETAILSWhat you’ll need
Experience, skills and essential requirements
- A strong background in applied AI, research engineering, ML or LLM systems.
- Hands-on agent evaluation experience; strong Python; experience with benchmarks, metrics and research pipelines; and the ability to identify root causes of model failures.
- You should understand agent architectures, robustness and generalisation, work through ambiguous problems and collaborate across research and customer teams.
- Production agent experience, reinforcement learning, reward modelling, research publications and open-source benchmarks are preferred additions.
You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.
05 / THE DETAILSPay and working arrangements
Rates, commitment and working arrangements
Remote, full-time employment. The detailed description states a USD base salary of $200,000–$250,000 per year. The listing header shows $100–$130 per hour, which conflicts with the annual salary terms. The salary above follows the detailed description, and the final offer should confirm the terms. Listed benefits include equity eligibility, possible performance bonuses, health-insurance reimbursement of up to 100%, paid time off and a matched 401(k), subject to policy. No eligible-country list is provided.
06 / THE DETAILSWhat happens next
How to move forward
Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps. The hiring process may use AI-assisted screening and assessment alongside human review.