Find Jobs in AI

AI EVALUATION WORK

AI evaluator jobs

AI evaluator jobs involve checking AI answers, images, code or specialist work against clear criteria. Browse current opportunities, compare pay and country rules, and read the tasks and skills before applying. These roles can also be called AI rater, AI response reviewer or model-evaluation jobs.

What would you submit?

A response reviewer may choose the stronger of two answers and explain the evidence. A quality analyst may flag inconsistent labels and give contributors feedback. A specialist evaluator may test code, review clinical documentation or check scientific reasoning. The deliverable could be a score, a corrected answer, a written explanation or a set of test cases.

Specialist AI evaluation and consulting work

An AI evaluation consultant may contribute subject expertise rather than build the model itself. Tasks can involve checking a proof, a legal argument, a clinical explanation or a software result. The title alone does not establish seniority or eligibility: compare the exact domain, required qualifications and expected deliverables with your own experience.

Which experience is relevant?

General review work can draw on quality assurance, editing, research and careful written judgement. Technical, legal and clinical roles may require specific qualifications, recent professional practice or a licence. “No previous AI experience” does not waive those requirements. Compare the actual tasks with truthful examples from your work, study or projects.

Remote work and country eligibility

A remote role can still be limited to a particular country, language or time zone. A US preference is different from a US-only requirement. Read the location and working-arrangements sections before applying, and confirm any country restriction that the listing leaves unstated.

How to compare the pay

Use the currency and pay basis in the full role description. An hourly range is different from payment for one assessment or accepted task, and it does not guarantee weekly hours. Check expected availability, contract or employment status, duration and payment timing. Rates below belong to individual listings, rather than a typical salary for every evaluator.

CURRENT OPPORTUNITIES

Explore live roles

599 roles

Location search matches the wording shown in each listing. “Remote” alone does not establish country eligibility. Experience labels do not replace the full requirements.

Showing 599 of 599 roles

Annotation & data quality 94 roles

Data annotation & evaluation · Experienced

Generalist — MacBook AI Research

Remote

Use careful online research and clear writing to help test and improve advanced AI models across different subject areas.

Online researchInformation synthesisAI evaluation
$40–$80 / hourRead role details ↗

Data annotation & evaluation · Not specified

Legal Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving legal reasoning, jurisdiction, citations and risk awareness. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Biology Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving biological reasoning and scientific accuracy. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Psychology Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving psychological concepts, interpretation and expert reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Mechanical Engineer Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving mechanical engineering calculations, units, standards and safety. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Financial Quality Lead (Talent Pool)

Remote · India, The United States

Lead the quality review of AI training work involving finance, calculations, accounting terminology and risk. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Architecture and Design Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving architecture, spatial reasoning, building systems, design and safety. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Python (ML-Focused) Team Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving Python, machine learning methods, statistics, reproducibility and data leakage. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Philosophy Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving philosophical concepts, arguments, logic and interpretation. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Red-Teaming Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving AI safety, adversarial prompts, risk assessment and evaluation policies. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Ubuntu/Linux User for AI Data Training

Remote · 61 eligible countries; see role details

Carry out and record practical computer tasks in Ubuntu/Linux for AI training.

Ubuntu/Linux User for AI Data TrainingAI response evaluationWritten feedback

Data annotation & evaluation · Not specified

Biomedical Engineering Quality Lead

Remote · The United States

Lead the quality review of AI training work involving biomedical engineering, calculations, regulation, units and safety.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Electrical Engineer Quality Lead

Remote · The United States

Lead the quality review of AI training work involving electrical engineering, circuit analysis, calculations and safety.

AI response evaluationWritten feedbackQuality assurance

Data annotation & evaluation · Not specified

Bash Team Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving Bash scripting, command safety, portability, debugging and error handling. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

AI training · Experienced

Music & Sound Annotation Expert

Remote

Listen closely to real-world recordings and document the musical and environmental sounds that are actually audible.

Analytical listeningMusic annotationAudio quality
$30–$45 / hourRead role details ↗

AI training · Experienced

AI Safety Data Annotator

Remote

Evaluate AI conversations against detailed safety policies and explain your ratings.

AI safety reviewClose readingPolicy-based annotation
Paid per task · amount not providedRead role details ↗

AI training · Experienced

Computer Vision Annotation Quality Reviewer

Remote · Bangladesh or India

Help improve visual training data by checking the labels attached to images and videos. This role focuses on finding inaccurate, incomplete or inconsistent annotations and explaining how they should be corrected.

Image annotationVideo annotationQuality review
Up to $2.50 / hourRead role details ↗

Research & other specialist review 333 roles

AI training · Experienced

AI Evaluation Rubric Auditor

Remote

Audit reviewer decisions on tests that measure how AI agents handle online shopping and delivery tasks.

Rubric auditingAI evaluationReviewer feedback
$60–$85 / hourRead role details ↗

Engineering · Not specified

3D Print Farm Operator / Print Lab Supervisor

Location not specified

A paid opportunity for people familiar with running and maintaining fleets of FDM and resin printers. The public page provides technical skill areas rather than a full project brief.

3D printingFDM and resin printersSlicing
$20–$60 / hourRead role details ↗

Research & STEM · Not specified

Semiconductor Yield / Defect Engineer — SEM Review

Location not specified

A paid specialist opportunity covering wafer fabrication, SEM defect review and semiconductor yield decisions. The public page provides technical skill areas rather than a full project brief.

Semiconductor yieldSEM defect reviewDefect classification
$20–$60 / hourRead role details ↗

Coding & data · Expert

Research Engineer — Reinforcement Learning

Remote

Build reinforcement learning environments, training pipelines and evaluation systems that turn experimental AI research into reliable, scalable software.

Reinforcement learningRL environment designSynthetic data
$200,000–$300,000 / yearRead role details ↗

Design & Creative · Experienced

Digital Artist — AI Image Critique

Remote · United States

Apply digital-art and photography skills to precise comparisons between original images and AI-generated counterparts.

Creative evaluationPortfolioTechnical feedback
$21–$35 / hourRead role details ↗

Languages · Not specified

Malay Quality Lead (Talent Pool)

Remote · Malaysia

Coordinate the quality of Malay language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

MalayAI response evaluationWritten feedback
Up to $25 / hourRead role details ↗

Languages · Not specified

Croatian Team Lead

Remote · Croatia

Coordinate the quality of Croatian language material and contributor reviews used in AI training.

CroatianAI response evaluationWritten feedback

Languages · Not specified

Italian Language Expert (Talent Pool)

Remote · Italy

Assess AI-generated Italian writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

ItalianAI response evaluationWritten feedback

Coding & data · Not specified

Rust Engineer (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving Rust code and programming explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.

Rust EngineerAI response evaluationWritten feedback

Coding & data · Not specified

Angular Engineer (Talent Pool)

Remote · Germany, India, The United States

Use your expertise to improve the accuracy and usefulness of AI training material involving Angular applications and engineering explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.

Angular EngineerAI response evaluationWritten feedback

Languages · Not specified

Bengali Team Lead

Remote · Bangladesh, India, Saudi Arabia, United Arab Emirates

Coordinate the quality of Bengali language material and contributor reviews used in AI training.

BengaliAI response evaluationWritten feedback

Languages · Not specified

Malayalam Team Lead

Remote · India, Qatar, Saudi Arabia, United Arab Emirates

Coordinate the quality of Malayalam language material and contributor reviews used in AI training.

MalayalamAI response evaluationWritten feedback

Languages · Not specified

Cantonese Quality Lead (Talent Pool)

Remote · Hong Kong

Coordinate the quality of Cantonese language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

CantoneseAI response evaluationWritten feedback

Languages · Not specified

Romanian Language Expert

Remote · Romania

Assess AI-generated Romanian writing and produce clearer reference content for AI training.

RomanianAI response evaluationWritten feedback

Coding & data · Not specified

SQL Engineer (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving SQL queries and database reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.

SQL EngineerAI response evaluationWritten feedback

Coding & data · Not specified

JavaScript Engineer (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving JavaScript code and technical reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.

JavaScript EngineerAI response evaluationWritten feedback

Science & research · Not specified

Physicist

Remote · Australia, Brazil, Canada, Germany, India, New Zealand, The United Kingdom, The United States

Use your expertise to improve the accuracy and usefulness of AI training material involving physics explanations and worked solutions.

PhysicistAI response evaluationWritten feedback

Languages · Not specified

Greek Language Expert

Remote · Greece

Assess AI-generated Greek writing and produce clearer reference content for AI training.

GreekAI response evaluationWritten feedback

Law · Not specified

Compliance and Regulatory Expert (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving compliance and regulatory analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.

Compliance and Regulatory ExpertAI response evaluationWritten feedback

Engineering · Not specified

Electrical Engineer

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving electrical engineering reasoning.

Electrical EngineerAI response evaluationWritten feedback

Science & research · Not specified

STEM & Technical Specialist — Rubric Design

Remote · The United States

Use your expertise to improve the accuracy and usefulness of AI training material involving advanced STEM problems and scoring rubrics.

STEM & Technical Specialist – Rubric DesignAI response evaluationWritten feedback

Languages · Not specified

English Language Expert

Remote · 27 eligible countries; see role details

Assess AI-generated English writing and produce clearer reference content for AI training.

EnglishAI response evaluationWritten feedback

Languages · Not specified

Thai Language Expert (Talent Pool)

Remote · Cambodia, Malaysia, Thailand

Assess AI-generated Thai writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

ThaiAI response evaluationWritten feedback

Languages · Not specified

Arabic Language Expert (Talent Pool)

Remote · Egypt, Saudi Arabia, South Africa

Assess AI-generated Arabic writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

ArabicAI response evaluationWritten feedback

Languages · Not specified

Slovenian Team Lead

Remote · Slovenia

Coordinate the quality of Slovenian language material and contributor reviews used in AI training.

SlovenianAI response evaluationWritten feedback

Languages · Not specified

Catalan Team Lead

Remote · France, Spain

Coordinate the quality of Catalan language material and contributor reviews used in AI training.

CatalanAI response evaluationWritten feedback

Languages · Not specified

Ukrainian Team Lead

Remote · Canada, Kazakhstan, Moldova, Poland, The United States, Ukraine

Coordinate the quality of Ukrainian language material and contributor reviews used in AI training.

UkrainianAI response evaluationWritten feedback

Languages · Not specified

Turkish Team Lead

Remote · The United States

Coordinate the quality of Turkish language material and contributor reviews used in AI training.

TurkishAI response evaluationWritten feedback

Business & finance · Not specified

Market Research Expert (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving market-research analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.

Market Research ExpertAI response evaluationWritten feedback

Business & finance · Not specified

Insurance Expert (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving insurance analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.

Insurance ExpertAI response evaluationWritten feedback

Languages · Not specified

Danish Language Expert

Remote · Denmark, Germany, Greenland

Assess AI-generated Danish writing and produce clearer reference content for AI training.

DanishAI response evaluationWritten feedback

Languages · Not specified

Finnish Team Lead

Remote · Finland

Coordinate the quality of Finnish language material and contributor reviews used in AI training.

FinnishAI response evaluationWritten feedback

Languages · Not specified

Catalan Language Expert

Remote · France, Spain

Assess AI-generated Catalan writing and produce clearer reference content for AI training.

CatalanAI response evaluationWritten feedback

Languages · Not specified

German Language Expert (Talent Pool)

Remote · Austria, Germany, Switzerland

Assess AI-generated German writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

GermanAI response evaluationWritten feedback

Languages · Not specified

Assamese Language Expert

Remote · Bangladesh, Bhutan, India

Assess AI-generated Assamese writing and produce clearer reference content for AI training.

AssameseAI response evaluationWritten feedback

Languages · Not specified

Russian Language Expert

Remote · Kazakhstan

Assess AI-generated Russian writing and produce clearer reference content for AI training.

RussianAI response evaluationWritten feedback

Science & research · Not specified

Chemist

Remote · Brazil, Germany, India, The United States

Use your expertise to improve the accuracy and usefulness of AI training material involving chemistry explanations and worked answers.

ChemistAI response evaluationWritten feedback

Languages · Not specified

Portuguese Language Expert (Talent Pool)

Remote · Brazil, Portugal

Assess AI-generated Portuguese writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

PortugueseAI response evaluationWritten feedback

Languages · Not specified

Persian Team Lead

Remote · 8 eligible countries; see role details

Coordinate the quality of Persian language material and contributor reviews used in AI training.

PersianAI response evaluationWritten feedback

Languages · Not specified

Norwegian Team Lead (Talent Pool)

Remote · Norway

Coordinate the quality of Norwegian language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

NorwegianAI response evaluationWritten feedback

Coding & data · Not specified

C# Engineer (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving C# code and engineering explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.

C# EngineerAI response evaluationWritten feedback
Up to $65 / hourRead role details ↗

Languages · Not specified

Latvian Team Lead (Talent Pool)

Remote · Latvia

Coordinate the quality of Latvian language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

LatvianAI response evaluationWritten feedback

Languages · Not specified

Odia (Oriya) Team Lead

Remote · Bangladesh, India, Indonesia, Thailand

Coordinate the quality of Odia language material and contributor reviews used in AI training.

OdiaAI response evaluationWritten feedback

Engineering · Not specified

Mechanical Engineer

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving mechanical engineering answers.

Mechanical EngineerAI response evaluationWritten feedback

Languages · Not specified

Malayalam Language Expert

Remote · India, Qatar, Saudi Arabia, United Arab Emirates

Assess AI-generated Malayalam writing and produce clearer reference content for AI training.

MalayalamAI response evaluationWritten feedback

Languages · Not specified

Public Health Expert (Talent Pool)

Remote · 17 eligible countries; see role details

Assess AI-generated Public writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

PublicAI response evaluationWritten feedback
Up to $70 / hourRead role details ↗

Languages · Not specified

Vietnamese Language Expert (Talent Pool)

Remote · Vietnam

Assess AI-generated Vietnamese writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

VietnameseAI response evaluationWritten feedback

Coding & data · Not specified

React Native Engineer (Talent Pool)

Remote · Germany, India, The United States

Use your expertise to improve the accuracy and usefulness of AI training material involving React Native applications and engineering explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.

React Native EngineerAI response evaluationWritten feedback

Languages · Not specified

Thai Team Lead (Talent Pool)

Remote · Cambodia, China, Thailand, The United Kingdom, The United States

Coordinate the quality of Thai language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

ThaiAI response evaluationWritten feedback

Languages · Not specified

Greek Team Lead

Remote · Greece

Coordinate the quality of Greek language material and contributor reviews used in AI training.

GreekAI response evaluationWritten feedback

Languages · Not specified

Odia (Oriya) Language Expert

Remote · Bangladesh, India, Indonesia, Thailand

Assess AI-generated Odia writing and produce clearer reference content for AI training.

OdiaAI response evaluationWritten feedback

Languages · Not specified

Assamese Team Lead

Remote · Bangladesh, Bhutan, India

Coordinate the quality of Assamese language material and contributor reviews used in AI training.

AssameseAI response evaluationWritten feedback

Languages · Not specified

Hebrew Language Expert (Talent Pool)

Remote · Israel

Assess AI-generated Hebrew writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.

HebrewAI response evaluationWritten feedback
Up to $50 / hourRead role details ↗

Law · Not specified

Legal Researcher (Talent Pool)

Remote · Germany, India, The United States

Use your expertise to improve the accuracy and usefulness of AI training material involving legal research and written analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.

Legal ResearcherAI response evaluationWritten feedback

Business & finance · Not specified

SEO & Digital Marketing Expert (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving SEO and digital-marketing recommendations. This is an application for future projects: the listing explicitly says there is no immediate assignment.

SEO & Digital Marketing ExpertAI response evaluationWritten feedback

Research & STEM · Experienced

Fighter Pilot — AI Evaluation

Remote · Worldwide

Assess AI-generated military aviation scenarios using firsthand professional experience.

military aviationScenario evaluationProfessional judgement
$40–$80 / hourRead role details ↗

Research & STEM · Experienced

Electrical Engineer — AI Technical Evaluation

Remote · United States, San Francisco Bay Area preferred

Bring practical electrical-engineering judgement to the design and review of AI training tasks and reference solutions.

Electrical engineeringCircuit designPower systems
$80–$120 / hourRead role details ↗

Finance · Experienced

Finance Expert — Spanish AI Evaluation (Spain)

Remote · Spain

Use your finance expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.

SpanishFinancial analysisProfessional judgement

Law · Experienced

Legal Expert — Spanish AI Evaluation (Spain)

Remote · Spain

Use your legal expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.

SpanishLegal analysisLocal legal practice

Finance · Experienced

Finance Expert — German AI Evaluation (Germany)

Remote · Germany

Use your finance expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.

GermanFinancial analysisProfessional judgement

Law · Experienced

Legal Expert — German AI Evaluation (Germany)

Remote · Germany

Use your legal expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.

GermanLegal analysisLocal legal practice

AI training · Experienced

AI Training Data Program Lead

Remote · United States

Lead contributor teams delivering AI training and model-evaluation work, turning research goals into clear instructions and consistent output.

Programme leadershipAI data operationsQuality management
$45–$70 / hourRead role details ↗

AI training · Experienced

Medicare Enrolment Specialist — AI Evaluation

Remote · United States

Help evaluate AI-generated information about Medicare and employer-benefit coordination. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

Medicare enrolmentEmployer benefitsSocial Security
$40–$60 / hourRead role details ↗

AI training · Experienced

Passport Acceptance Expert — AI Evaluation

Remote · United States

Help evaluate AI-generated information about passport application guidance. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

Passport applicationsIdentity documentsPublic services
$30–$40 / hourRead role details ↗

AI training · Experienced

Consular & Passport Specialist — AI Evaluation

Remote · United States

Help evaluate AI-generated information about complex passport and citizenship questions. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

Passport adjudicationCitizenship documentationCase review
$50–$70 / hourRead role details ↗

AI training · Experienced

Federal Student Loan Adviser — AI Evaluation

Remote · United States

Help evaluate AI-generated information about federal student-loan repayment and forgiveness. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

Student loan repaymentBorrower counsellingFinancial aid
$30–$50 / hourRead role details ↗

AI training · Experienced

National Park Visitor Services Expert — AI Evaluation

Remote · United States

Help evaluate AI-generated information about US national park visitor information. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

National Park servicesVisitor informationPermits and passes
$30–$45 / hourRead role details ↗

AI training · Experienced

Spanish & English Benefits Adviser — AI Review

Remote · United States

Help evaluate AI-generated information about government-service guidance in Spanish and English. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

SpanishEnglishBenefits counselling
$35–$50 / hourRead role details ↗

AI training · Experienced

Postal Services Expert — AI Answer Review

Remote · United States

Help evaluate AI-generated information about postal-service questions and AI-generated answers. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

USPS counter servicesMailing rulesCustomer enquiries
$30–$45 / hourRead role details ↗

Writing & language · Experienced

English Teacher — AI Assistant Evaluation

Remote · United States

Use classroom experience and English-language judgement to assess how well AI assistants handle realistic teaching and communication tasks.

English teachingGoogle ClassroomAI evaluation
$15–$40 / hourRead role details ↗

Engineering & robotics · Experienced

Senior Electronics Quality Engineer — AI Inspection Evaluation

Remote

Use practical electronics inspection and failure-analysis experience to review engineering evidence and improve the examples used to train AI systems. The work focuses on PCB assembly, wire harnesses and semiconductor packaging.

IPC 610 & IPC 620 InspectionPCB CAM & Gerber ReviewSMT/AOI Defect Analysis
$70–$120 / hourRead role details ↗

Law · Expert

Legal and Compliance AI Specialist

Remote · all countries

Use your legal experience to help assess the accuracy and clarity of AI-generated legal work across research, contracts and compliance.

Legal researchContract analysisRegulatory compliance
$60–140 / hourRead role details ↗

Research & STEM · Expert

Mechanical Engineering Expert — AI Review

Remote

Help assess whether AI can reason reliably about real mechanical engineering work. Drawing on your experience with physical products, you will review engineering decisions and produce examples that distinguish a plausible explanation from a technically sound, practical answer.

Mechanical engineeringProduct designSimulation review
$100–$120 / hourRead role details ↗

Coding & data · Experienced

MongoDB Specialist — AI Workflow Training

Remote · Bangladesh, India, Pakistan

Help AI systems learn how people complete real document database work tasks using MongoDB. You will devise practical assignments, demonstrate them on your computer and provide enough documentation for a reviewer to follow the work.

MongoDBDocument databasesQuery review
Up to $20 / hourRead role details ↗

AI training · Experienced

Blender Specialist — AI Computer-Use Training

Remote · Australia, Bangladesh, Bhutan, Brazil, Cambodia, China, Fiji, Hong Kong, India, Indonesia, Japan, Kazakhstan, Kyrgyzstan, Macau, Malaysia, Mongolia, Nauru, Nepal, New Zealand, Pakistan, Singapore, South Korea, Sri Lanka, Taiwan, Tajikistan, Thailand, Philippines, United States, Timor-Leste, Uzbekistan, Vietnam

Turn professional Blender work into demonstrations and benchmarks that help AI agents use desktop creative software. You will create realistic tasks, record how you complete them and define the evidence needed to judge whether the result is correct.

Blender3D modellingWorkflow evaluation
Up to $30 / hourRead role details ↗

Writing & language · Experienced

Bulgarian Language Expert — AI Content Review

Remote · Bulgaria

Use your Bulgarian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

BulgarianLanguage quality reviewFact-checking
Up to $20 / hourRead role details ↗

Writing & language · Experienced

Croatian Language Expert — AI Content Review

Remote · Croatia

Use your Croatian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

CroatianLanguage quality reviewFact-checking
Up to $25 / hourRead role details ↗

Writing & language · Experienced

Czech Language Expert — AI Content Review

Remote · Czech Republic

Use your Czech language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

CzechLanguage quality reviewFact-checking
Up to $25 / hourRead role details ↗

Writing & language · Experienced

Estonian Language Expert — AI Content Review

Remote · Estonia

Use your Estonian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

EstonianLanguage quality reviewFact-checking
Up to $35 / hourRead role details ↗

Writing & language · Experienced

Hungarian Language Expert — AI Content Review

Remote · Hungary

Use your Hungarian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

HungarianLanguage quality reviewFact-checking
Up to $25 / hourRead role details ↗

Writing & language · Experienced

Latvian Language Expert — AI Content Review

Remote · Latvia

Use your Latvian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

LatvianLanguage quality reviewFact-checking
Up to $20 / hourRead role details ↗

Writing & language · Experienced

Lithuanian Language Expert — AI Content Review

Remote · Lithuania

Use your Lithuanian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

LithuanianLanguage quality reviewFact-checking
Up to $25 / hourRead role details ↗

Writing & language · Experienced

Maltese Language Expert — AI Content Review

Remote · Malta

Use your Maltese language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

MalteseLanguage quality reviewFact-checking
Up to $40 / hourRead role details ↗

Writing & language · Experienced

Persian Language Expert — AI Content Review

Remote · Tajikistan

Use your Persian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

PersianLanguage quality reviewFact-checking
Up to $25 / hourRead role details ↗

Writing & language · Experienced

Slovak Language Expert — AI Content Review

Remote · Slovakia

Use your Slovak language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

SlovakLanguage quality reviewFact-checking
Up to $20 / hourRead role details ↗

Writing & language · Experienced

Slovenian Language Expert — AI Content Review

Remote · Slovenia

Use your Slovenian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.

SlovenianLanguage quality reviewFact-checking
Up to $25 / hourRead role details ↗

Research & STEM · Experienced

FreeCAD Mechanical Design Specialist — AI Workflow Training

Remote · Bangladesh, Bhutan, Brazil, Cambodia, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, Philippines, United States, Timor-Leste and Vietnam

Demonstrate how reliable mechanical design work is carried out in FreeCAD. You will design realistic tasks, record your own complete workflows and define checks that distinguish a robust engineering model from one that only looks correct.

FreeCADParametric modellingMechanical design
Up to $30 / hourRead role details ↗

AI training · Experienced

Social Sciences & Education Quality Lead — AI Training

Remote · India

Lead quality review for AI training projects involving social sciences, education and learning. You will assess content, support contributors and help the team apply consistent standards for evidence, teaching quality, social context and ethical judgement.

Social science reviewEducation quality assuranceTeam coordination
Up to $20 / hourRead role details ↗

AI training · Experienced

Toast POS Specialist — AI Workflow Review

Remote

Turn your experience with restaurant point-of-sale systems into practical guidance for an AI project. You will examine Toast workflows and explain how features should behave in real restaurant settings.

Toast POSRestaurant operationsProcess documentation
$28–$92 / hourRead role details ↗

Coding & software evaluation 37 roles

Coding & data · Experienced

Machine Learning Researcher — AI Evaluation

Remote · Worldwide

Build reproducible research and engineering exercises that test how well AI handles machine learning problems.

Machine learning researchPythonReproducible experiments
Paid per qualifying task · $60–$120/hour referenceRead role details ↗

Engineering · Experienced

Quality Control Engineer — AI Technical Evaluation

Remote · India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey or Mexico

Review whether technical tasks, outputs and verification checks meet a consistent quality standard.

Software engineeringQuality controlVerification
Contractor project · rate unspecifiedRead role details ↗

Coding · Experienced

Software Quality Control Engineer — AI Evaluation

Remote · India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico

Use software engineering and quality control experience to assess technical tasks and how their outputs are verified.

Software engineeringQuality controlVerification
Contract engagement · rate not providedRead role details ↗

Coding & data · Expert

Embedded Software & Firmware Expert — AI Evaluation

Remote

Use your experience building software for real hardware to evaluate AI engineering work. The project needs practitioners who understand how firmware, embedded code and programmable logic behave outside an isolated software example, including the constraints that affect reliability in deployed systems.

Embedded systemsFirmwareHardware debugging
$100–$120 / hourRead role details ↗

Healthcare & clinical review 76 roles

Medicine & Health · Experienced

Medical Doctor — Medical AI Evaluation

Remote · Worldwide

Help evaluate how AI systems interpret medical information using your experience in clinical medicine across specialties.

clinical medicine across specialtiesClinical reasoningEvidence review
$25–$35 / hourRead role details ↗

Medicine & Health · Experienced

Radiologist — Medical AI Evaluation

Remote · Worldwide

Help evaluate how AI systems interpret medical information using your experience in radiology and diagnostic imaging.

radiology and diagnostic imagingClinical reasoningEvidence review
Paid contractor projectRead role details ↗

Healthcare · Not specified

Dentist (Talent Pool)

Remote · 17 eligible countries; see role details

Use your expertise to improve the accuracy and usefulness of AI training material involving dental and oral-health reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.

DentistAI response evaluationWritten feedback
Up to $90 / hourRead role details ↗

Data annotation & evaluation · Not specified

Medical Quality Lead (Talent Pool)

Remote · The United States

Lead the quality review of AI training work involving medical reasoning, clinical accuracy and patient safety. This is an application for future projects: the listing explicitly says there is no immediate assignment.

AI response evaluationWritten feedbackQuality assurance

Medicine & healthcare · Experienced

US Pharmacist — AI Medication Review

Remote · United States

Help improve AI-supported prior-authorisation workflows by checking medication-related answers for safety, accuracy and completeness.

PharmacyMedication safetyPrior authorisation

Medicine & healthcare · Experienced

Medical Expert — Spanish AI Evaluation (Spain)

Remote · Spain

Use your medical expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.

SpanishClinical practiceMedical review

Medicine & healthcare · Experienced

Medical Expert — German AI Evaluation (Germany)

Remote · Germany

Use your medical expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.

GermanClinical practiceMedical review

Healthcare & life sciences · Experienced

Behavioural Health Expert — AI Safety Evaluation

Remote · United States

Help evaluate how AI responds to sensitive everyday discussions about relationships, emotional wellbeing, family dynamics and beliefs. The focus is balanced, supportive conversation with appropriate boundaries, rather than treating the user or giving directive clinical advice.

Behavioral HealthAI SafetyModel Evaluation
$45–$70 / hourRead role details ↗

Healthcare & life sciences · Experienced

Hospitalist Reviewer — Clinical Documentation

Remote

Review inpatient clinical records for accuracy, completeness and consistency with the patient encounter. This project uses hospitalist judgement to improve documentation reviews and the standards used to assess them.

CDIInpatient MedicineClinical Documentation
$100–$150 / hourRead role details ↗

Medicine & healthcare · Expert

Clinical Medicine AI Specialist

Remote · all countries

Apply clinical knowledge to improve the accuracy and safety of AI-generated medical information. The projects involve careful assessment of clinical reasoning and patient-facing content.

Clinical reasoningMedical terminologyGuideline review
$70–150 / hourRead role details ↗

Medicine & healthcare · Expert

Medical Communications Specialist — AI Evaluation

Remote

Apply your medical communications experience to evaluating AI-generated scientific materials. The project needs professional judgement about accuracy, balance and how clearly information is presented to healthcare professionals or patients.

Medical communicationsScientific reviewMedical education
$50–$80 / hourRead role details ↗

Research & STEM · Expert

Clinical Publications Reviewer — AI Writing Evaluation

Remote

Apply medical publication experience to the evaluation of AI-assisted scientific writing. You will help distinguish sound clinical interpretation from unsupported claims and give researchers clear feedback on the quality of AI-generated publication drafts.

Medical writingClinical data interpretationScientific publication review
$50–$80 / hourRead role details ↗

Writing & language review 53 roles

AI training · Experienced

Medicare Counsellor — AI Answer Evaluation

Remote · United States

Help evaluate AI-generated information about Medicare enrolment and plan choices. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

Medicare counsellingEligibility rulesRubric writing
$30–$60 / hourRead role details ↗

AI training · Experienced

Veterans Benefits Adviser — AI Evaluation

Remote · United States

Help evaluate AI-generated information about veterans’ benefits and claims. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

VA claimsVeterans benefitsAppeals
$40–$60 / hourRead role details ↗

AI training · Experienced

211 Information & Referral Specialist — AI Evaluation

Remote · United States

Help evaluate AI-generated information about public-benefit questions and community referrals. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

211 servicesPublic benefitsCommunity referrals
$30–$40 / hourRead role details ↗

Law · Expert

Litigation & Motion Practice Specialist — AI Evaluation

Remote

Help improve AI tools that support legal advocacy by bringing practical litigation judgement to a part-time fellowship. You will work through realistic legal exercises and assess whether AI responses reflect persuasive writing, sound reasoning and effective litigation strategy.

Federal civil litigationMotion practiceLegal writing
$150–$300 / hourRead role details ↗

Writing & language · Experienced

Education Assessment Specialist — AI Writing Review

Remote

Bring assessment experience to the review of AI-generated writing. You will compare responses, apply scoring criteria and explain whether the writing is accurate, useful and appropriate for its intended audience.

Assessment designRubric scoringAcademic writing review
$90–$140 / hourRead role details ↗

Roles listed as entry level 6 roles

AI training · Entry level

AI Conversation Evaluator

Remote · Worldwide

Use your personal ChatGPT account to compare AI assistants in everyday conversations and explain which experience worked better.

AI assistant useConversation evaluationWritten feedback
$45–$70 / hourRead role details ↗

AI training · Entry level

Government Services Consumer Reviewer

Remote · United States

Help evaluate AI-generated information about the clarity and usefulness of government-service answers. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

Consumer feedbackPlain languageOnline tasks
$20–$30 / hourRead role details ↗

AI training · Entry level

Spanish & English Consumer Reviewer — AI Answers

Remote · United States

Help evaluate AI-generated information about the clarity of government-service answers in Spanish and English. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.

SpanishEnglish comprehensionConsumer feedback
$20–$30 / hourRead role details ↗
Explore all opportunities ↗

BEFORE YOU APPLY

Questions about ai evaluator jobs

What does an AI evaluator do?

An AI evaluator reviews a model’s work against task instructions and scoring criteria. Depending on the role, you may compare answers, check facts, test generated code, assess images or review specialist reasoning. Useful feedback identifies the issue and the evidence behind the score.

Can I apply without previous AI experience?

Some roles accept transferable experience in writing, research, quality assurance or another professional field. That does not remove mandatory requirements such as an active clinical licence, a particular language, relevant professional experience or residence in an eligible country. Check the individual role.

Are AI evaluator jobs remote?

Many opportunities support remote work, but remote does not mean open worldwide. Each role shows its location rules. Check country restrictions, work authorisation, equipment and required time-zone overlap before applying.

How are AI evaluators paid?

Payment can be hourly or per accepted task. The rate and pay basis belong to the individual listing; they are not a guaranteed salary or weekly income. Read the working arrangements for hours, project length, payment conditions and any information the listing does not provide.

What happens after I apply?

Apply through Find Jobs in AI using your profile and CV. Our team reviews your application and contacts you about the next steps if you are a good fit. A profile or application is not a guarantee of an assignment.

See how an AI evaluation rubric works ↗