Find Jobs in AI All opportunities
Open for applicationsAI training

Data Science & Analytics Expert — AI Workflow Evaluation

3 openings
Pay
$60–$100 / hour
Location
Remote · Worldwide
Experience level
Expert

A CLOSER LOOK

Explore the opportunity

01 / THE DETAILS

Role overview

Get to know the opportunity

Assess AI reasoning in large-scale analytic workflows and LLM-enabled data pipelines.

02 / THE DETAILS

What you’ll be doing

Your day-to-day contribution
  • Create cases covering triage, enrichment, automation and realistic pipeline failures.
  • Grade responses for source handling, reasoning, limitations and practical usefulness.
  • Document edge cases and identify refusals that interrupt legitimate analytic work.
03 / THE DETAILS

Who this could suit

See where your experience could fit

Data scientists and technical leaders with experience integrating LLMs into operational analytics.

04 / THE DETAILS

What you’ll need

Experience, skills and essential requirements
  • Practical LLM pipeline integration, analysis at scale and knowledge of automation failure modes and evaluation metrics are requested.
  • Strong technical English and teaching, mentoring or leadership experience are needed.
  • Benchmark design and government, defence or intelligence analytic-domain experience are valued.

You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.

05 / THE DETAILS

Pay and working arrangements

Rates, commitment and working arrangements

$60–$100 USD per hour. Remote contractor engagement listed as open worldwide. Weekly hours, project duration and payment timing are not specified.

06 / THE DETAILS

What happens next

How to move forward

Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps.

Practice for this role

Review a specialist conclusion

A quality report required checks on five samples. Four passed, and the fifth was not measured. The draft says “All five samples passed, so the batch meets the release rule.”

Explain what the evidence supports and what you would ask the team to check before release.

Sign in for private feedback or work through the example below.

See the rubric and example answer
  • Evidence · Four passed and the fifth has no recorded result.
  • Conclusion · The evidence does not establish that all five passed or that the release rule was met.
  • Follow-up · Measure and document the fifth sample before deciding.

Four samples passed. There is no result for the fifth, so the release rule has not been verified. Measure and document the fifth sample before deciding.

Application checklist
Requirements from the listing

Practical LLM pipeline integration, analysis at scale and knowledge of automation failure modes and evaluation metrics are requested. Strong technical English and teaching, mentoring or leadership experience are needed. Benchmark design and government, defence or intelligence analytic-domain experience are valued.

Sign in to check your saved CV.

Pay$60–$100 / hour
Continue to apply