01 / THE DETAILSRole overview
Get to know the opportunity
Assess AI reasoning in large-scale analytic workflows and LLM-enabled data pipelines.
02 / THE DETAILSWhat you’ll be doing
Your day-to-day contribution
- Create cases covering triage, enrichment, automation and realistic pipeline failures.
- Grade responses for source handling, reasoning, limitations and practical usefulness.
- Document edge cases and identify refusals that interrupt legitimate analytic work.
03 / THE DETAILSWho this could suit
See where your experience could fit
Data scientists and technical leaders with experience integrating LLMs into operational analytics.
04 / THE DETAILSWhat you’ll need
Experience, skills and essential requirements
- Practical LLM pipeline integration, analysis at scale and knowledge of automation failure modes and evaluation metrics are requested.
- Strong technical English and teaching, mentoring or leadership experience are needed.
- Benchmark design and government, defence or intelligence analytic-domain experience are valued.
You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.
05 / THE DETAILSPay and working arrangements
Rates, commitment and working arrangements
$60–$100 USD per hour. Remote contractor engagement listed as open worldwide. Weekly hours, project duration and payment timing are not specified.
06 / THE DETAILSWhat happens next
How to move forward
Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps.