Role overview
Bring assessment experience to the review of AI-generated writing. You will compare responses, apply scoring criteria and explain whether the writing is accurate, useful and appropriate for its intended audience.
What you’ll be doing
- Compare written AI responses for clarity, tone, usefulness and compliance with the brief.
- Score the work using the supplied rubric and explain the evidence behind each rating.
- Identify unsupported assertions, factual mistakes and contradictions.
- Distinguish a thorough-looking answer from one that actually helps the reader.
- Record decisions in the project review tools and discuss difficult cases with other reviewers.
Who this could suit
Educators, examiners, assessment designers and academic writing reviewers accustomed to evaluating written work against defined standards.
What you’ll need
The preferred profile includes experience grading or examining written work, together with work in assessment design, instructional design, peer review, thesis supervision or academic writing support. First-language-level or equivalent written English is preferred. A completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia or New Zealand is a stated preference, rather than an unconditional degree requirement. You should be able to produce objective written rationales and manage remote deadlines. Previous model evaluation or annotation work is helpful but not required.
You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.
Pay and working arrangements
Remote contractor work paying $90–$140 per hour. The project is described as flexible enough to fit alongside other professional commitments; no fixed weekly hours, duration or payment frequency is stated.
What happens next
Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps.