Data annotation & evaluation · Experienced
Generalist for Data Annotation
Remote
Label and review image data to help improve the quality of AI training material.
AI EVALUATION WORK
AI evaluator jobs involve checking AI answers, images, code or specialist work against clear criteria. Browse current opportunities, compare pay and country rules, and read the tasks and skills before applying. These roles can also be called AI rater, AI response reviewer or model-evaluation jobs.
A response reviewer may choose the stronger of two answers and explain the evidence. A quality analyst may flag inconsistent labels and give contributors feedback. A specialist evaluator may test code, review clinical documentation or check scientific reasoning. The deliverable could be a score, a corrected answer, a written explanation or a set of test cases.
An AI evaluation consultant may contribute subject expertise rather than build the model itself. Tasks can involve checking a proof, a legal argument, a clinical explanation or a software result. The title alone does not establish seniority or eligibility: compare the exact domain, required qualifications and expected deliverables with your own experience.
General review work can draw on quality assurance, editing, research and careful written judgement. Technical, legal and clinical roles may require specific qualifications, recent professional practice or a licence. “No previous AI experience” does not waive those requirements. Compare the actual tasks with truthful examples from your work, study or projects.
A remote role can still be limited to a particular country, language or time zone. A US preference is different from a US-only requirement. Read the location and working-arrangements sections before applying, and confirm any country restriction that the listing leaves unstated.
Use the currency and pay basis in the full role description. An hourly range is different from payment for one assessment or accepted task, and it does not guarantee weekly hours. Check expected availability, contract or employment status, duration and payment timing. Rates below belong to individual listings, rather than a typical salary for every evaluator.
CURRENT OPPORTUNITIES
Location search matches the wording shown in each listing. “Remote” alone does not establish country eligibility. Experience labels do not replace the full requirements.
Showing 599 of 599 roles
Data annotation & evaluation · Experienced
Remote
Label and review image data to help improve the quality of AI training material.
Data annotation & evaluation · Experienced
Remote
Use careful online research and clear writing to help test and improve advanced AI models across different subject areas.
Law · Experienced
Remote · United States
Help create and review legally accurate AI training examples covering international human rights, discrimination and US civil liberties.
Law · Experienced
Remote · United States
Help create and review legally accurate AI training examples covering property transactions, ownership disputes, titles, zoning and leasing.
Law · Experienced
Remote · United States
Help create and review legally accurate AI training examples covering wills, trusts, probate, inheritance disputes and estate tax planning.
Law · Experienced
Remote · United States
Help create and review legally accurate AI training examples covering copyright infringement, fair use, licensing and intellectual-property ownership.
Law · Experienced
Remote · United States
Help create and review legally accurate AI training examples covering judicial review, due process, equal protection, federalism and First Amendment issues.
Writing & language · Experienced
Remote · Belgium or Switzerland
Help improve speech recognition by reviewing conversations in Belgian or Swiss French and correcting automatic transcripts.
Writing & language · Experienced
Remote · Portugal
Help improve speech recognition by reviewing conversations in European Portuguese and correcting automatic transcripts.
Writing & language · Experienced
Remote · Brazil
Help improve speech recognition by reviewing conversations in Brazilian Portuguese and correcting automatic transcripts.
Writing & language · Experienced
Remote · Argentina or Colombia
Help improve speech recognition by reviewing conversations in Latin American Spanish and correcting automatic transcripts.
Writing & language · Experienced
Remote · Mexico
Help improve speech recognition by reviewing conversations in Mexican Spanish and correcting automatic transcripts.
Writing & language · Experienced
Remote · Spain
Help improve speech recognition by reviewing conversations in Peninsular Spanish and correcting automatic transcripts.
Writing & language · Experienced
Remote · France
Help improve speech recognition by reviewing conversations in French as spoken in France and correcting automatic transcripts.
Writing & language · Experienced
Remote · Canada
Help improve speech recognition by reviewing conversations in Canadian French and correcting automatic transcripts.
Finance & law · Experienced
Remote · US-based professionals sought
Use US competition law expertise to improve the legal examples used to train and evaluate AI systems.
Finance & law · Experienced
Remote
Help improve how AI systems interpret realistic US civil rights matters.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Swahili by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Hindi by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Peruvian Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Chinese as used in Singapore by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Australian English by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Romanian by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Japanese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Greek by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Arabic by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Polish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Mexican Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Chinese as used in Hong Kong by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated British English by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Finnish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Italian by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Hebrew by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Traditional Chinese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Brazilian Portuguese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Colombian Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Mainland Chinese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Ukrainian by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Dutch by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated French by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Thai by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Simplified Chinese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated European Portuguese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Chilean Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated German by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Turkish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Danish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Indonesian by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Korean by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Venezuelan Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Argentine Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated New Zealand English by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Vietnamese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Czech by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Bangla by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Latin American Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated US Spanish by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Taiwanese Mandarin in Traditional Chinese by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Canadian English by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Russian by reviewing and improving text for the intended audience.
Language · Experienced
Remote · Worldwide
Help improve the quality of AI-generated Armenian by reviewing and improving text for the intended audience.
Legal · Expert
Remote
Build and review AI training material about US employment and labour law.
Legal · Expert
Remote
Use US intellectual property experience to improve how AI interprets legal documents and cases.
Design & creative · Experienced
Remote
Use trained listening skills to assess short music recordings and AI descriptions of them.
Data annotation & evaluation · Experienced
United States
Review how digital systems handle personal and sensitive information and identify where data could be exposed or misused.
Data annotation & evaluation · Experienced
United States
Test personal AI assistants to see how they respond when a request involves sensitive information.
Data annotation & evaluation · Expert
Remote · United States
Assess how AI systems handle security and safety questions and whether their responses meet policy.
Design & creative · Expert
Remote · United States
Use professional video judgment to compare AI-generated clips and explain which one works better.
Design & Creative · Experienced
Remote · United States
Review images carefully and explain visual-quality differences for an AI data project.
AI training · Experienced
Remote
Create accurate video labels using clear project instructions and consistent judgement.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving legal reasoning, jurisdiction, citations and risk awareness. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving biological reasoning and scientific accuracy. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving psychological concepts, interpretation and expert reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving mechanical engineering calculations, units, standards and safety. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · India, The United States
Lead the quality review of AI training work involving finance, calculations, accounting terminology and risk. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving architecture, spatial reasoning, building systems, design and safety. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving Python, machine learning methods, statistics, reproducibility and data leakage. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving philosophical concepts, arguments, logic and interpretation. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving AI safety, adversarial prompts, risk assessment and evaluation policies. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · 61 eligible countries; see role details
Carry out and record practical computer tasks in Ubuntu/Linux for AI training.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving biomedical engineering, calculations, regulation, units and safety.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving electrical engineering, circuit analysis, calculations and safety.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving Bash scripting, command safety, portability, debugging and error handling. This is an application for future projects: the listing explicitly says there is no immediate assignment.
AI training · Experienced
Remote
Listen closely to real-world recordings and document the musical and environmental sounds that are actually audible.
Finance & law · Experienced
Remote · United States
Review patent-related AI work and explain its legal, technical and citation errors.
AI training · Entry level
Remote
Judge how accurately short audio and video clips match a given query.
Research & STEM · Experienced
Remote · US citizenship and active CAC required
Annotate imagery and assess visual details for a US Navy AI-data project.
Research & STEM · Experienced
Remote · United States
Annotate imagery and assess visual details for a US Navy AI-data project.
AI training · Experienced
Remote
Lead quality decisions and reviewer calibration for complex AI annotation work.
Research & STEM · Expert
Remote
Apply practical technical documentation and parts analysis expertise to specialist AI training and evaluation work.
AI training · Experienced
Remote
Label shot boundaries and scene structure in video clips to support AI training.
AI training · Experienced
Remote
Evaluate AI conversations against detailed safety policies and explain your ratings.
AI training · Experienced
Remote · Bangladesh or India
Help improve visual training data by checking the labels attached to images and videos. This role focuses on finding inaccurate, incomplete or inconsistent annotations and explaining how they should be corrected.
AI training · Experienced
Remote
Apply music-teaching experience to examples and feedback that improve AI understanding of musical structure.
AI training · Experienced
Remote
Use practical telecommunications experience to improve how AI handles troubleshooting, escalation and resolution for services such as VoIP, mobile or broadband.
AI training · Experienced
Remote
Use practical retail experience to improve how AI handles orders, returns, refunds, deliveries and complaints.
AI training · Experienced
Remote
Use practical airline service experience to improve how AI handles reservations, cancellations, delays, rebooking, baggage and disruption management.
Coding & data · Experienced
Remote
Guide security-data reviews and quality checks within an AI evaluation team.
AI training · Experienced
Remote · United States or Canada
Apply professional direct-service social or community work judgement to realistic AI evaluation examples.
AI training · Experienced
Remote · United States or Canada
Apply professional creative production judgement to realistic AI evaluation examples.
AI training · Experienced
Remote · United States or Canada
Apply professional teaching and education judgement to realistic AI evaluation examples.
Coding & data · Experienced
Remote
Lead a cybersecurity evaluation team and establish consistent review standards for AI training data.
AI training · Experienced
Remote · United States
Evaluate AI-assistant responses from the perspective of an existing everyday user.
AI training · Experienced
Remote
Evaluate product discovery, shopping journeys and concierge-style interactions to improve AI customer experiences.
AI training · Experienced
Remote
Review AI commercial decisions using grocery, travel or electronics category-management expertise.
Finance · Experienced
Remote · United States
Use practical private equity judgement to test and improve how AI handles financial workbooks.
Finance · Experienced
Remote · United States
Use practical investment banking judgement to test and improve how AI handles financial workbooks.
Finance · Experienced
Remote · United States
Use practical asset management judgement to test and improve how AI handles financial workbooks.
Finance · Experienced
Remote · United States
Use practical commercial banking judgement to test and improve how AI handles financial workbooks.
Finance · Experienced
Remote · United States
Use practical wealth management judgement to test and improve how AI handles financial workbooks.
AI training · Experienced
Remote · United States
Compare original images with generated versions and describe errors precisely.
AI training · Experienced
Remote
Review human animation sequences for natural movement and physical plausibility.
AI training · Experienced
Remote · Europe
Compare two AI agents on everyday mobile tasks and report how well they complete each request.
AI training · Experienced
Remote
Audit reviewer decisions on tests that measure how AI agents handle online shopping and delivery tasks.
AI training · Experienced
Remote
Use your physics research experience to build and validate questions that measure how well AI handles advanced scientific reasoning.
Business & operations · Experienced
Remote · United States
Use frontline B2B sales management experience to evaluate how an AI system reviews enterprise deals and coaches account executives.
Finance · Expert
Remote · Worldwide
Build and assess AI tasks based on the budgets, forecasts and business questions that financial planning and analysis teams handle.
Business & operations · Experienced
Remote
Lead complex AI data projects from technical scoping through quality review and delivery.
Engineering · Experienced
Remote
Lead internal platform engineering and quality engineering for a data-intensive business.
Finance · Experienced
Remote · United States and Canada
Apply your underwriting judgement to commercial insurance scenarios covering risk, pricing and coverage.
Business & operations · Experienced
Remote
Use commercial consulting experience to improve AI work on sales, marketing and business strategy.
Business & operations · Experienced
Remote
Use your consulting background to test the accuracy and usefulness of quantitative or technical AI outputs.
Business & operations · Experienced
Remote · Canada, United States
Use your experience running independent client work to evaluate how well AI handles everyday professional workflows.
Finance · Experienced
Remote · United States
Use client-facing planning experience to evaluate AI advice on realistic household finances.
Finance · Experienced
Remote
Assess AI answers about small-business accounting and help define what a sound answer should cover.
Legal · Experienced
Remote · Worldwide · US practice experience
Use US paralegal experience to help evaluate AI work on realistic legal tasks.
Finance · Experienced
Remote
Apply equity or credit research experience to the financial examples and analysis used to train AI systems.
Finance · Experienced
Remote · United States
Use federal loan-servicing experience to assess whether AI answers borrower questions correctly.
Legal · Experienced
Remote
Use paralegal experience to improve legal training data for AI systems.
Legal · Expert
Remote
Build reliable legal training examples grounded in US corporate and transaction work.
Finance & law · Experienced
Remote · United States
Apply individual tax preparation experience to evaluating how AI handles complex US personal tax scenarios.
Business & operations · Experienced
Remote
Review AI work on federal equal employment, position classification and workforce procedures.
Business & operations · Experienced
Remote · United States
Evaluate whether AI correctly reasons about US social insurance claims and benefits.
Business & operations · Experienced
Remote · United States
Help an AI team evaluate how well models handle business customer support, success and technical onboarding.
Research & STEM · Experienced
Remote
Lead the creation and review of transistor-level analog circuit tasks with objective simulation-based scoring.
Science · Expert
Remote
Apply bioinformatics and medicinal chemistry expertise to data and model outputs used in drug discovery research.
Coding · Expert
Remote · United States
Use low-level engineering experience to assess AI-generated systems and hardware design work.
Business & operations · Expert
Remote · United States
Help AI teams measure the quality of planning, analysis and other professional operations work.
Coding · Expert
Remote · United States
Build technical evaluations that test AI-generated machine learning and scientific computing work.
Finance · Expert
Remote · United States
Use finance experience to test whether AI produces accurate models, valuations and analyses.
Engineering · Expert
Remote · United States
Evaluate how well AI handles real mechanical design and parametric CAD work.
Business & operations · Expert
Remote · United States
Help assess whether AI can resolve realistic customer support issues accurately and professionally.
Science · Expert
Remote · United States
Evaluate machine-generated mathematical statements and proofs using interactive theorem provers.
Coding · Expert
Remote · United States
Create realistic infrastructure and reliability benchmarks for AI systems.
Legal · Expert
Remote
Review AI legal reasoning on operational law and international humanitarian law.
Design & creative · Experienced
Remote
Evaluate generated videos using professional editing, motion graphics and visual effects judgment.
AI training · Experienced
Remote · United States
Evaluate how AI reasons about emerging technology and strategic competition.
Engineering · Not specified
Location not specified
A paid opportunity for people familiar with running and maintaining fleets of FDM and resin printers. The public page provides technical skill areas rather than a full project brief.
Engineering · Not specified
Location not specified
A paid opportunity focused on visual softwood grading and sawmill quality knowledge. The public page provides technical skill areas rather than a full project brief.
Research & STEM · Not specified
Location not specified
A paid specialist opportunity covering wafer fabrication, SEM defect review and semiconductor yield decisions. The public page provides technical skill areas rather than a full project brief.
Engineering · Expert
Remote
Use practical electronics manufacturing experience to evaluate solder-joint reliability and component authenticity cases for AI training.
Engineering · Expert
Remote
Evaluate first-article inspection work and explain whether a measurement discrepancy comes from the part or the inspection setup.
Engineering · Expert
Remote
Apply outboard engine service expertise to realistic diagnostic and repair cases used in AI training.
Science · Experienced
Remote · Worldwide
Develop and review scientific problems and reproducible Python analyses for AI evaluation.
Coding & data · Expert
Remote
Build reinforcement learning environments, training pipelines and evaluation systems that turn experimental AI research into reliable, scalable software.
Finance & law · Expert
Remote
Apply humanitarian and human-rights law expertise to realistic legal scenarios and evaluate how AI handles civilian protection, legal boundaries and uncertainty.
Engineering · Experienced
Remote
Use model-based systems engineering to create reference models and assess generated SysML v2 work.
Finance · Experienced
Remote · United States
Use current individual-tax preparation experience to create traceable examples and assess the accuracy of generated US federal returns.
Design & Creative · Expert
Remote · United States
Use professional judgement in commercial music and audio post-production to create realistic benchmarks and evaluate generative AI output.
Design & Creative · Expert
Remote · United States
Use professional judgement in architectural drawing and spatial visualisation to create realistic benchmarks and evaluate generative AI output.
Design & Creative · Expert
Remote · United States
Use professional judgement in 3D asset production and animation to create realistic benchmarks and evaluate generative AI output.
Design & Creative · Expert
Remote · United States
Use professional judgement in brand identity and advertising design to create realistic benchmarks and evaluate generative AI output.
Design & Creative · Expert
Remote · United States
Use professional judgement in motion graphics and code-driven animation to create realistic benchmarks and evaluate generative AI output.
Design & Creative · Expert
Remote · United States
Use professional judgement in commercial editing and finishing to create realistic benchmarks and evaluate generative AI output.
Design & Creative · Experienced
Remote · United States
Use original visual work and detailed comparisons to help assess and improve AI-generated images.
Design & Creative · Experienced
Remote · United States
Apply digital-art and photography skills to precise comparisons between original images and AI-generated counterparts.
Engineering · Experienced
Remote
Assess practical mechanical engineering tasks for AI evaluation in enterprise product design, manufacturing and analysis.
Engineering · Experienced
Remote
Assess practical electrical engineering tasks for AI evaluation in enterprise circuit, power-system and product design.
Engineering · Experienced
Remote
Assess practical civil engineering tasks for AI evaluation in infrastructure design, construction and public works.
Engineering · Experienced
Remote
Build and validate network configurations and simulated or emulated topologies for realistic AI evaluation.
Engineering · Experienced
Remote
Build and validate electrical designs and executable engineering simulations for realistic AI evaluation.
Engineering · Experienced
Remote
Build and validate CAD, analysis and simulation workflows for realistic AI evaluation.
Coding · Experienced
Remote
Evaluate static-analysis tools using controlled, runnable examples of security weaknesses in AI applications.
Design & Creative · Experienced
Remote
Check edited images against their original versions and written instructions for an AI image-training project.
Design & Creative · Experienced
Remote
Create, edit and annotate stylised visual assets while maintaining consistent materials, texture and composition.
AI training · Experienced
Remote
Evaluate how personalised AI responses use selected context from a personal Google account.
Design & creative · Experienced
Remote · United States
Help improve generated images by comparing them closely with original photographs and explaining what has changed or gone wrong.
AI training · Experienced
Remote · United States
Turn practical federal human-resources experience into realistic cases and reference material for an AI evaluation project.
AI training · Experienced
Remote · United States
Use federal programme and policy experience to create credible scenarios and assess professional reference material for AI training.
Finance · Experienced
Remote · United States
Apply federal audit and oversight experience to realistic cases that test AI reasoning about government assurance work.
AI training · Experienced
Remote · United States
Help build realistic evaluation tasks around federal rulemaking, regulatory analysis and responses to public comments.
AI training · Experienced
Remote · United States
Use practical federal acquisition knowledge to design contracting scenarios and assess the accuracy of AI evaluation materials.
Design & Creative · Experienced
Remote
Use production and visual-storytelling experience to create and assess video material for AI projects.
AI training · Experienced
Remote · United States
Compare two AI agents carrying out everyday phone-based tasks and document how each performs.
Research & STEM · Experienced
Remote
Apply hands-on nanomaterial analysis to expert evaluation work supporting AI development.
Research & STEM · Experienced
Remote
Assess the technical accuracy of medium-voltage protection examples used in AI training.
Design & Creative · Experienced
Remote · Worldwide
Assess creative commissioning decisions, budgets and image-usage agreements.
Design & Creative · Experienced
Remote · Worldwide
Use production-design experience to assess whether proposed sets would work on a real production.
Design & Creative · Experienced
Remote · Worldwide
Judge photographic and moving-image work against professional production standards.
Design & Creative · Experienced
Remote · Worldwide
Assess fashion looks and interior styling using practical experience of client work.
Design & Creative · Experienced
Remote · Worldwide
Assess campaign and social content for creative quality, brand alignment and its intended channel.
Design & Creative · Experienced
Remote · Worldwide
Bring curatorial judgement to the selection, attribution and presentation of artworks and photographs.
Research & STEM · Expert
Remote
Build reproducible computational life-science workflows that test whether AI agents can carry out authentic scientific work.
Finance · Experienced
Remote · United States
Use practical borrower-support experience to test whether AI gives useful, up-to-date guidance on US federal student loans.
Design & creative · Experienced
Remote · United States
Apply your visual judgement to evaluating how closely AI images match original photographic work.
Writing & language · Experienced
Remote · United States
Assess spoken English and help improve the naturalness and fluency of AI language output.
AI training · Experienced
Remote · United States
Bring federal grants experience to an AI training project covering funding applications, award decisions and compliance monitoring.
Finance · Experienced
Remote · United States
Use federal budgeting experience to create realistic financial examples and assess the accuracy of generated budget guidance.
Research & STEM · Experienced
Remote
Use veterans-benefits expertise to assess simulated claims work and improve AI decision support.
Coding & data · Experienced
Remote
Evaluate AI-generated federal IT work using practical operations and information-security experience.
Research & STEM · Experienced
Remote
Assess investigation scenarios and case documentation to improve the realism and accuracy of AI training material.
Research & STEM · Experienced
Remote
Apply certified non-destructive-testing expertise to aerospace composite-inspection examples.
Research & STEM · Experienced
Remote
Create reference system models and assess the quality of AI-generated SysML v2 work.
Design & Creative · Experienced
Remote · United States
Use digital-art experience to assess subtle differences between original work and AI-generated images.
Coding & data · Experienced
Remote · United States
Apply data-quality judgement to assess datasets and AI-related deliverables.
Finance & law · Experienced
Remote · Worldwide
Build finance research questions whose answers can be checked against reliable public-company filings.
Business & operations · Experienced
Remote
Test an AI research-and-insights product as a real business end user.
Business & operations · Experienced
Remote
Review business prompts and executive presentations for clarity, accuracy and professional quality.
Research & STEM · Expert
Remote
Create research-grade biology problems and assess the scientific reasoning of advanced AI models.
Coding & data · Experienced
Remote
Create digital-hardware design tasks with verified RTL solutions and meaningful synthesis and correctness tests.
Languages · Not specified
Remote · Malaysia
Coordinate the quality of Malay language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Croatia
Coordinate the quality of Croatian language material and contributor reviews used in AI training.
Languages · Not specified
Remote · Italy
Assess AI-generated Italian writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Coding & data · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving Rust code and programming explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · India, The United Kingdom, The United States
Assess AI-generated Gujarati writing and produce clearer reference content for AI training.
Coding & data · Not specified
Remote · Germany, India, The United States
Use your expertise to improve the accuracy and usefulness of AI training material involving Angular applications and engineering explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Bangladesh, India, Saudi Arabia, United Arab Emirates
Coordinate the quality of Bengali language material and contributor reviews used in AI training.
Languages · Not specified
Remote · India, Qatar, Saudi Arabia, United Arab Emirates
Coordinate the quality of Malayalam language material and contributor reviews used in AI training.
Languages · Not specified
Remote · Hong Kong
Coordinate the quality of Cantonese language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Romania
Assess AI-generated Romanian writing and produce clearer reference content for AI training.
Coding & data · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving SQL queries and database reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Coding & data · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving JavaScript code and technical reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Science & research · Not specified
Remote · Australia, Brazil, Canada, Germany, India, New Zealand, The United Kingdom, The United States
Use your expertise to improve the accuracy and usefulness of AI training material involving physics explanations and worked solutions.
Languages · Not specified
Remote · Greece
Assess AI-generated Greek writing and produce clearer reference content for AI training.
Law · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving compliance and regulatory analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · India, The United Kingdom, The United States
Coordinate the quality of Gujarati language material and contributor reviews used in AI training.
Languages · Not specified
Remote · India, Mauritius, Pakistan
Coordinate the quality of Marathi language material and contributor reviews used in AI training.
Engineering · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving electrical engineering reasoning.
Science & research · Not specified
Remote · The United States
Use your expertise to improve the accuracy and usefulness of AI training material involving advanced STEM problems and scoring rubrics.
Languages · Not specified
Remote · 27 eligible countries; see role details
Assess AI-generated English writing and produce clearer reference content for AI training.
Languages · Not specified
Remote · Cambodia, Malaysia, Thailand
Assess AI-generated Thai writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Egypt, Saudi Arabia, South Africa
Assess AI-generated Arabic writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Slovenia
Coordinate the quality of Slovenian language material and contributor reviews used in AI training.
Languages · Not specified
Remote · France, Spain
Coordinate the quality of Catalan language material and contributor reviews used in AI training.
Languages · Not specified
Remote · Canada, Kazakhstan, Moldova, Poland, The United States, Ukraine
Coordinate the quality of Ukrainian language material and contributor reviews used in AI training.
Languages · Not specified
Remote · The United States
Coordinate the quality of Turkish language material and contributor reviews used in AI training.
Business & finance · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving market-research analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Business & finance · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving insurance analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Denmark, Germany, Greenland
Assess AI-generated Danish writing and produce clearer reference content for AI training.
Languages · Not specified
Remote · Finland
Coordinate the quality of Finnish language material and contributor reviews used in AI training.
Languages · Not specified
Remote · France, Spain
Assess AI-generated Catalan writing and produce clearer reference content for AI training.
Languages · Not specified
Remote · Austria, Germany, Switzerland
Assess AI-generated German writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Bangladesh, Bhutan, India
Assess AI-generated Assamese writing and produce clearer reference content for AI training.
Languages · Not specified
Remote · Kazakhstan
Assess AI-generated Russian writing and produce clearer reference content for AI training.
Languages · Not specified
Remote · India, Malaysia, Saudi Arabia, The United States, United Arab Emirates
Assess AI-generated Kannada writing and produce clearer reference content for AI training.
Science & research · Not specified
Remote · Brazil, Germany, India, The United States
Use your expertise to improve the accuracy and usefulness of AI training material involving chemistry explanations and worked answers.
Languages · Not specified
Remote · Brazil, Portugal
Assess AI-generated Portuguese writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · 8 eligible countries; see role details
Coordinate the quality of Persian language material and contributor reviews used in AI training.
Languages · Not specified
Remote · Norway
Coordinate the quality of Norwegian language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Coding & data · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving C# code and engineering explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Latvia
Coordinate the quality of Latvian language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Bangladesh, India, Indonesia, Thailand
Coordinate the quality of Odia language material and contributor reviews used in AI training.
Engineering · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving mechanical engineering answers.
Languages · Not specified
Remote · India, Qatar, Saudi Arabia, United Arab Emirates
Assess AI-generated Malayalam writing and produce clearer reference content for AI training.
Languages · Not specified
Remote · 17 eligible countries; see role details
Assess AI-generated Public writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Vietnam
Assess AI-generated Vietnamese writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Coding & data · Not specified
Remote · Germany, India, The United States
Use your expertise to improve the accuracy and usefulness of AI training material involving React Native applications and engineering explanations. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · India, The United States, United Arab Emirates
Coordinate the quality of Telugu language material and contributor reviews used in AI training.
Languages · Not specified
Remote · Cambodia, China, Thailand, The United Kingdom, The United States
Coordinate the quality of Thai language material and contributor reviews used in AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Languages · Not specified
Remote · Greece
Coordinate the quality of Greek language material and contributor reviews used in AI training.
Languages · Not specified
Remote · Bangladesh, India, Indonesia, Thailand
Assess AI-generated Odia writing and produce clearer reference content for AI training.
Languages · Not specified
Remote · Bangladesh, Bhutan, India
Coordinate the quality of Assamese language material and contributor reviews used in AI training.
Languages · Not specified
Remote · Israel
Assess AI-generated Hebrew writing and produce clearer reference content for AI training. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Law · Not specified
Remote · Germany, India, The United States
Use your expertise to improve the accuracy and usefulness of AI training material involving legal research and written analysis. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Business & finance · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving SEO and digital-marketing recommendations. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Writing & language · Experienced
Remote
Assess Brazilian Portuguese language material to improve the fluency and accuracy of AI systems.
Writing & language · Experienced
Remote
Assess Korean language material to improve the fluency and accuracy of AI systems.
Writing & language · Experienced
Remote
Assess French language material to improve the fluency and accuracy of AI systems.
Writing & language · Experienced
Remote
Assess Japanese language material to improve the fluency and accuracy of AI systems.
Writing & language · Experienced
Remote
Assess German language material to improve the fluency and accuracy of AI systems.
Writing & language · Experienced
Remote
Assess Hindi language material to improve the fluency and accuracy of AI systems.
Research & STEM · Expert
Remote · United States
Use senior expertise in mathematical research to evaluate the quality of AI reasoning and develop demanding research benchmarks.
Research & STEM · Expert
Remote · United States
Use senior expertise in life sciences research to evaluate the quality of AI reasoning and develop demanding research benchmarks.
Research & STEM · Expert
Remote · United States
Use senior expertise in chemistry research to evaluate the quality of AI reasoning and develop demanding research benchmarks.
Research & STEM · Expert
Remote · United States
Use senior expertise in physics research to evaluate the quality of AI reasoning and develop demanding research benchmarks.
Writing & language · Experienced
Remote
Coach Mandarin pronunciation and delivery and evaluate speech samples for an AI project.
Finance & law · Experienced
Remote
Assess and improve AI-generated federal litigation arguments using proven motion-practice experience.
Research & STEM · Experienced
Remote
Assess AI scenarios using firsthand civilian intelligence-agency experience.
Finance & law · Experienced
Remote · United States or India
Apply federal individual-income-tax expertise to AI reasoning and review tasks.
Research & STEM · Experienced
Remote
Use civilian defence-analysis expertise to assess the realism and reasoning of AI military scenarios.
Research & STEM · Experienced
Remote
Assess AI-generated scenarios using practical intelligence collection and operations experience.
Research & STEM · Experienced
Remote
Assess AI-generated scenarios using practical civilian intelligence practice experience.
Research & STEM · Experienced
Remote
Apply marine-geology experience to core descriptions, sediment interpretation and AI training examples.
Research & STEM · Experienced
Remote
Assess aviation material using commercial-pilot and flight-operations expertise.
Research & STEM · Experienced
Remote
Assess AI-generated scenarios using practical national-security intelligence analysis experience.
Finance & law · Expert
Remote
Assess gaming and gambling regulation scenarios for an AI legal project.
Finance & law · Expert
Remote
Use product-safety law expertise to improve regulatory AI training examples.
Research & STEM · Expert
Remote · Worldwide
Apply practical flight operations expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote · Worldwide
Apply practical industrial trades and maintenance expertise to specialist AI training and evaluation work.
Coding & data · Expert
Remote
Apply practical AI security evaluation expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote
Apply practical military operations and humanitarian law expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote · Worldwide
Apply practical advanced non-destructive inspection expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote · Worldwide
Apply practical cargo surveying expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote · Worldwide
Apply practical specialty inspections expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote · Worldwide
Apply practical claims investigation expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote · Worldwide
Apply practical property damage and restoration expertise to specialist AI training and evaluation work.
Research & STEM · Expert
Remote · Worldwide
Assess vehicle condition and damage evidence using senior appraisal or inspection experience.
Finance & law · Experienced
Remote
Evaluate legal workflows and AI-generated work in Microsoft 365.
Business & operations · Experienced
Remote
Evaluate marketing workflows and AI-generated work in Microsoft 365.
Writing & language · Experienced
Remote
Assess Tamil speech and language material to improve AI fluency and accuracy.
Finance & law · Experienced
Remote · US/Canada preferred; UK and Latin America considered
Use management/strategy consulting experience to build and assess realistic AI work tasks.
Finance & law · Experienced
Remote · US/Canada preferred; UK and Latin America considered
Use financial due diligence and transaction accounting experience to build and assess realistic AI work tasks.
Finance & law · Experienced
Remote · US/Canada preferred; UK and Latin America considered
Use investment banking and M&A experience to build and assess realistic AI work tasks.
Finance & law · Experienced
Remote · US/Canada preferred; UK and Latin America considered
Use corporate finance and financial modelling experience to build and assess realistic AI work tasks.
Finance & accounting · Experienced
Remote
Use practical retail banking expertise to improve the accuracy of AI financial reasoning.
Finance & accounting · Experienced
Remote
Use practical consumer lending expertise to improve the accuracy of AI financial reasoning.
Finance & accounting · Experienced
Remote
Use practical mortgage lending expertise to improve the accuracy of AI financial reasoning.
Finance & accounting · Experienced
Remote
Use practical corporate banking expertise to improve the accuracy of AI financial reasoning.
Finance & accounting · Experienced
Remote
Use practical commercial banking expertise to improve the accuracy of AI financial reasoning.
Research & STEM · Experienced
Remote · Latin America, Southeastern Europe, Asia or Africa
Assess whether AI conversations gather enough relevant context before offering advice.
AI training · Experienced
Remote · United States
Evaluate personalised AI responses using context from your connected Google accounts.
AI training · Experienced
Remote
Use your established educational AI-app experience to review and improve model responses.
Business & operations · Experienced
Remote
Explain how restaurant teams use Toast POS in everyday operations.
AI training · Experienced
Remote
Assess food-delivery AI responses for useful, accurate customer communication.
Business & operations · Experienced
Remote
Build realistic strategy and public-policy problems that test the quality of AI analysis.
Finance & accounting · Experienced
Remote
Create and review finance, accounting and investment benchmarks for AI evaluation.
Design & creative · Experienced
Remote
Develop specialist AI benchmarks based on market research, media production or technical communications.
Business & operations · Experienced
Remote
Create realistic enterprise sales and customer-success tasks for AI evaluation.
Coding & data · Expert
Remote
Own staff-level quality engineering architecture and delivery in an AI-focused engineering environment.
Research & STEM · Experienced
Remote
Assess AI-generated defence analysis scenarios using firsthand professional experience.
Research & STEM · Experienced
Remote
Assess AI-generated Army combat operations scenarios using firsthand professional experience.
Research & STEM · Experienced
Remote
Assess AI-generated military operations scenarios using firsthand professional experience.
Research & STEM · Experienced
Remote
Assess AI-generated military weapons systems scenarios using firsthand professional experience.
Research & STEM · Experienced
Remote · Worldwide
Assess AI-generated special operations scenarios using firsthand professional experience.
Research & STEM · Experienced
Remote · Worldwide
Assess AI-generated military aviation scenarios using firsthand professional experience.
Business & operations · Experienced
Remote · United States or Canada
Assess realistic SaaS revenue-operations decisions across CRM systems and connected business tools.
Business & operations · Experienced
Remote · United States or Canada
Assess realistic SaaS revenue-operations decisions across CRM systems and connected business tools.
Law · Expert
Remote · Worldwide
Assess legal reasoning about energy regulation using direct experience of utility and power-market practice.
Law · Expert
Remote · Worldwide
Review legal AI content involving gaming regulation, licensing and cross-border compliance.
Law · Expert
Remote · Worldwide
Bring product safety and consumer regulation expertise to legal AI training and evaluation.
Law · Expert
Remote · Worldwide
Assess the accuracy and clarity of AI-generated military law material.
Law · Expert
Remote · Worldwide
Review AI legal reasoning about media rights, publishing and communications regulation.
Law · Expert
Remote · Worldwide
Use structured finance transaction experience to assess legal documents and model-generated reasoning.
Law · Expert
Remote · Worldwide
Assess legal and regulatory content involving FDA requirements and life sciences compliance.
Law · Expert
Remote · Worldwide
Assess investment and corporate-law material used to develop legal AI systems.
Law · Expert
Remote · Worldwide
Apply funds and asset-management experience to the accuracy of legal AI content.
Law · Experienced
Remote · United States
Use legal research and editorial skills to check the accuracy of materials for AI training.
Finance · Experienced
Remote · Worldwide
Apply claims judgement to evidence-based insurance scenarios used to improve AI systems.
AI training · Experienced
Remote · Worldwide
Use air cargo and parcel claims experience to review shipment evidence and explain custody and liability decisions.
AI training · Experienced
Remote · Worldwide
Assess maritime imagery and documentation to improve the quality of specialist AI data and reasoning.
AI training · Expert
Remote · Worldwide
Review how AI systems handle military-domain questions against an approved evaluation taxonomy.
Design & creative · Expert
Remote · United States
Define and evaluate camera and lighting quality in generated video for an AI research team.
Design & creative · Expert
Remote · United States
Define and evaluate performance and staging quality in generated video for an AI research team.
Design & creative · Expert
Remote · United States
Define and evaluate visual effects and preproduction quality in generated video for an AI research team.
Coding & data · Expert
Remote · Worldwide
Design and assess ML-systems tasks that reveal weaknesses in AI reasoning about infrastructure and performance.
Law · Experienced
Remote · Worldwide
Improve legal AI datasets through careful document review, citation checking and written legal analysis.
Research & STEM · Expert
Remote · London (UK) / US East Coast
Bring practical chemistry expertise to the design and evaluation of scientific AI tasks.
Research & STEM · Expert
Remote · London (UK) / US East Coast
Use recent laboratory or computational biology experience to improve scientific AI tasks and evaluations.
AI training · Expert
Remote · Worldwide
Use specialist knowledge to design challenging tasks and assess the accuracy of advanced AI responses.
Law · Experienced
Remote · Worldwide
Turn law-journal citation experience into clear examples and scoring guidance for legal AI evaluation.
Law · Experienced
Remote · Worldwide
Use law-review editing skills to improve how legal citation checking is assessed.
Law · Experienced
Remote · Worldwide
Create and review citation-checking examples that help assess legal AI accuracy.
Research & STEM · Experienced
Remote · Worldwide
Demonstrate real industrial or manufacturing engineering workflows to help researchers benchmark and improve AI systems.
Research & STEM · Expert
Remote · Worldwide
Use deep biological-data expertise to review research workflows and improve the quality of AI benchmarks.
Research & STEM · Expert
Remote · Worldwide
Review chemistry problems, research workflows and AI reasoning for scientific accuracy and reproducibility.
AI training · Experienced
Remote · India, Japan or United Kingdom
Run detailed model and agent evaluations and record how AI products perform under practical testing conditions.
Writing & language · Experienced
Remote · Worldwide
Compare AI-generated videos using professional judgement about cinematography, visual effects, continuity and performance.
Writing & language · Experienced
California or New York, United States · Remote with on-site sessions
Help evaluate whether AI performance-transfer systems preserve an actor’s timing, emotion and physical choices.
Research & STEM · Expert
Remote · Worldwide
Combine experimental and computational knowledge to assess whether AI-generated life-science research is accurate and scientifically sound.
Coding & data · Experienced
Remote · Worldwide
Create realistic security test applications and evaluation tasks that help assess AI or scanner behaviour.
Research & STEM · Experienced
Remote · United States, San Francisco Bay Area preferred
Bring practical electrical-engineering judgement to the design and review of AI training tasks and reference solutions.
Finance · Experienced
Remote · Spain
Use your finance expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.
Research & STEM · Experienced
Remote · Spain
Use your consulting expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.
Law · Experienced
Remote · Spain
Use your legal expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.
Research & STEM · Experienced
Remote · Spain
Use your stem expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.
AI training · Experienced
Remote · Spain
Use your human-resources expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.
Finance · Experienced
Remote · Germany
Use your finance expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.
Research & STEM · Experienced
Remote · Germany
Use your consulting expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.
Law · Experienced
Remote · Germany
Use your legal expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.
Research & STEM · Experienced
Remote · Germany
Use your stem expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.
AI training · Experienced
Remote · Germany
Use your human-resources expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.
Finance · Experienced
Remote · mainland China
Use your finance expertise and Mandarin Chinese fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in mainland China’s local practices and terminology.
Research & STEM · Experienced
Remote · mainland China
Use your consulting expertise and Mandarin Chinese fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in mainland China’s local practices and terminology.
Law · Experienced
Remote · mainland China
Use your legal expertise and Mandarin Chinese fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in mainland China’s local practices and terminology.
Research & STEM · Experienced
Remote · mainland China
Use your stem expertise and Mandarin Chinese fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in mainland China’s local practices and terminology.
AI training · Experienced
Remote · mainland China
Use your human-resources expertise and Mandarin Chinese fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in mainland China’s local practices and terminology.
Finance · Expert
Remote · Worldwide
Use transaction-advisory experience to improve AI analysis of companies, valuations and acquisition or sale processes.
Research & STEM · Experienced
Remote · Worldwide
Contribute practical environmental and land-management expertise to AI training and evaluation projects.
AI training · Experienced
Remote · Worldwide
Assess whether AI-generated retail scenarios and operational decisions reflect how the work is done in practice.
Law · Experienced
Remote · United States
Use professional personal injury-law judgement to improve the accuracy of AI-generated legal analyses and documents.
Law · Experienced
Remote · United States
Use professional employment-law judgement to improve the accuracy of AI-generated legal analyses and documents.
Law · Experienced
Remote · United States
Use professional tax-law judgement to improve the accuracy of AI-generated legal analyses and documents.
Coding & data · Experienced
Remote · Worldwide
Develop partnerships with businesses that can contribute operational workflow data for AI training and evaluation.
Coding & data · Experienced
Remote · United States
Review business datasets and transformed documents to help keep AI training material accurate and appropriately protected.
Writing & language · Experienced
Remote · Worldwide
Prepare and quality-check Brazilian Portuguese voice recordings for speech and text-to-speech AI datasets.
AI training · Experienced
Remote · United States
Lead contributor teams delivering AI training and model-evaluation work, turning research goals into clear instructions and consistent output.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about Medicare and employer-benefit coordination. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about passport application guidance. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about complex passport and citizenship questions. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about federal student-loan repayment and forgiveness. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about US national park visitor information. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about government-service guidance in Spanish and English. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about postal-service questions and AI-generated answers. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
Finance · Experienced
Remote · Worldwide
Apply trading-desk experience to assess whether AI-generated rates strategies reflect real market conditions.
Finance · Experienced
Remote · Worldwide
Use company analysis and sector expertise to improve AI systems working with financial research.
Writing & language · Experienced
Remote · United States
Use classroom experience and English-language judgement to assess how well AI assistants handle realistic teaching and communication tasks.
Finance & law · Expert
Remote
Apply technology-contract expertise to improve AI systems that analyse legal risks and support contract review.
STEM · Experienced
Remote · Worldwide
Own robotics data operations from capture through delivery, balancing quality, throughput and cost.
Creative & design · Experienced
Remote
Use professional voice knowledge to explain the qualities of short speech recordings and help improve AI speech systems.
Engineering & robotics · Experienced
Remote
Create demanding, verifiable mechanical design questions from complex CAD assemblies and review AI reasoning.
Finance & accounting · Experienced
Remote · United States
Review household tax and financial workflows in a short-term AI evaluation project.
Engineering & robotics · Experienced
Remote
Apply non-destructive testing expertise to inspection evidence used in AI training.
Engineering & robotics · Experienced
Remote
Turn practical equipment diagnostics into clear evidence and explanations for AI training.
Engineering & robotics · Experienced
Remote
Use practical electronics inspection and failure-analysis experience to review engineering evidence and improve the examples used to train AI systems. The work focuses on PCB assembly, wire harnesses and semiconductor packaging.
Engineering & robotics · Experienced
Remote
Assess materials and weld inspection evidence to support reliable AI engineering judgement.
Engineering & robotics · Experienced
Remote
Bring aircraft inspection and regulatory experience to the review of aviation training data.
Engineering & robotics · Experienced
Remote
Contribute experienced inspection judgement to AI datasets spanning aerospace, defence and marine work.
Law · Expert
Remote · all countries
Use your legal experience to help assess the accuracy and clarity of AI-generated legal work across research, contracts and compliance.
Research & STEM · Expert
Remote
Use hands-on hardware experience to assess complex engineering decisions and help improve how AI systems reason about physical products.
Research & STEM · Expert
Remote
Help assess whether AI can reason reliably about real mechanical engineering work. Drawing on your experience with physical products, you will review engineering decisions and produce examples that distinguish a plausible explanation from a technically sound, practical answer.
Coding & data · Experienced
Remote · Bangladesh, India, Pakistan
Help AI systems learn how people complete real document database work tasks using MongoDB. You will devise practical assignments, demonstrate them on your computer and provide enough documentation for a reviewer to follow the work.
AI training · Experienced
Remote · Australia, Bangladesh, Bhutan, Brazil, Cambodia, China, Fiji, Hong Kong, India, Indonesia, Japan, Kazakhstan, Kyrgyzstan, Macau, Malaysia, Mongolia, Nauru, Nepal, New Zealand, Pakistan, Singapore, South Korea, Sri Lanka, Taiwan, Tajikistan, Thailand, Philippines, United States, Timor-Leste, Uzbekistan, Vietnam
Turn professional Blender work into demonstrations and benchmarks that help AI agents use desktop creative software. You will create realistic tasks, record how you complete them and define the evidence needed to judge whether the result is correct.
Writing & language · Experienced
Remote · Bulgaria
Use your Bulgarian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Croatia
Use your Croatian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Czech Republic
Use your Czech language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Estonia
Use your Estonian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Hungary
Use your Hungarian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Latvia
Use your Latvian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Lithuania
Use your Lithuanian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Malta
Use your Maltese language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Tajikistan
Use your Persian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Slovakia
Use your Slovak language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Writing & language · Experienced
Remote · Slovenia
Use your Slovenian language expertise to improve the quality of AI-generated writing. This role combines close editorial review with reference-answer writing, so models receive clear examples of accurate, natural and culturally appropriate communication.
Research & STEM · Experienced
Remote · Bangladesh, Bhutan, Brazil, Cambodia, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, Philippines, United States, Timor-Leste and Vietnam
Demonstrate how reliable mechanical design work is carried out in FreeCAD. You will design realistic tasks, record your own complete workflows and define checks that distinguish a robust engineering model from one that only looks correct.
AI training · Experienced
Remote · India
Lead quality review for AI training projects involving social sciences, education and learning. You will assess content, support contributors and help the team apply consistent standards for evidence, teaching quality, social context and ethical judgement.
AI training · Experienced
Remote
Turn your experience with restaurant point-of-sale systems into practical guidance for an AI project. You will examine Toast workflows and explain how features should behave in real restaurant settings.
Coding & data · Entry level
Remote
Label and investigate cybersecurity examples that support AI training and evaluation.
Coding & data · Experienced
Remote
Turn real open-source software issues into reliable AI coding evaluations.
Coding & data · Experienced
Remote · Worldwide
Turn practical machine learning engineering work into tasks that can measure the reliability and performance of AI systems.
Coding & data · Experienced
Remote · Worldwide
Build reproducible research and engineering exercises that test how well AI handles machine learning problems.
Research & STEM · Experienced
Remote · Worldwide
Design scientific computing exercises that test how AI analyses physiological signals and clinical time series.
AI training · Experienced
Remote
Develop reproducible research exercises for evaluating how AI systems interpret biological data.
Engineering · Experienced
Remote
Build reproducible CAD and simulation exercises for evaluating AI on engineering design problems.
Engineering · Experienced
Remote · India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey or Mexico
Review whether technical tasks, outputs and verification checks meet a consistent quality standard.
AI training · Experienced
Remote
Run specified workflows in desktop software to produce reference outputs for AI evaluation.
Coding & data · Experienced
Remote
Own delivery, staffing and quality across multiple evaluation teams.
Coding · Experienced
Remote · Worldwide
Create and assess full-stack engineering tasks that test how AI works across an application.
Engineering · Experienced
Remote
Design engineering simulation problems that test how AI systems handle design constraints and technical trade-offs.
Coding & data · Experienced
Remote
Lead reviewers and coordinate reproducible software-security benchmark deliveries.
Coding · Experienced
Remote
Improve and validate code in existing open-source repositories for an AI training project.
Coding · Experienced
Remote
Create original algorithmic problems and reliable ways to score AI solutions.
Coding · Experienced
Remote · Latin America
Use JavaScript experience to build or review realistic software engineering benchmark tasks.
Coding · Experienced
Remote · Latin America
Use Python experience to build or review realistic software engineering benchmark tasks.
Coding · Experienced
Remote · India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico
Use software engineering and quality control experience to assess technical tasks and how their outputs are verified.
Coding · Expert
Remote · United States
Test whether AI can solve realistic software engineering problems across multiple files.
Coding · Experienced
Remote · Worldwide
Use experience shipping public technical work to create and assess realistic tasks for AI systems.
Coding & data · Experienced
Remote
Develop the benchmarks, datasets and research tools used to measure and improve advanced AI coding agents.
Coding & data · Expert
Remote
Evaluate and improve AI agents used in enterprise workflows, turning failures observed in practice into targeted experiments and more reliable systems.
Coding & data · Expert
Remote
Lead research and evaluation projects that improve frontier AI, from benchmark design and reinforcement learning environments to analysis of model capability gaps.
Engineering · Experienced
Remote
Lead end-to-end delivery of coding-data pipelines through clear specifications and coordinated execution.
Coding · Experienced
Remote · India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey and Mexico
Prepare and test real C++ repositories to assess AI bug-fixing and software-engineering performance.
Coding & data · Expert
Remote · United States
Use deep ownership of an established open-source project to build realistic software-engineering tasks and assess generated solutions.
Coding & data · Experienced
Remote · Worldwide
Design and assess reproducible Rust backend work for AI coding evaluation.
Research & STEM · Expert
Remote · Worldwide
Develop and review scientific problems that help AI systems reason more accurately about life sciences.
Coding & data · Experienced
Remote · Worldwide
Demonstrate real development workflows to help researchers benchmark and improve AI systems.
Research & STEM · Expert
Remote · Worldwide
Demonstrate authentic scientific research workflows to help improve the evaluation of AI models.
Coding & data · Expert
Remote · Worldwide
Develop and validate machine-learning engineering tasks for AI training and evaluation.
Research & STEM · Expert
Remote · Worldwide
Build and validate aerodynamic analysis tasks using physical reasoning and reproducible computational workflows.
Research & STEM · Expert
Remote · Worldwide
Create and review mechanical-engineering problems that connect physical requirements to reproducible analysis.
Research & STEM · Expert
Remote · Worldwide
Create and assess expert scientific problems involving molecular modelling, structural biology and drug-discovery workflows.
Finance · Experienced
Remote · Worldwide
Review AI-generated fixed-income research and strategy analysis for sound methods and realistic trading assumptions.
Engineering & robotics · Experienced
Remote
Use practical shop and field judgement to assess technical drawings and operating plans for AI training.
Coding & data · Expert
Remote
Use your experience building software for real hardware to evaluate AI engineering work. The project needs practitioners who understand how firmware, embedded code and programmable logic behave outside an isolated software example, including the constraints that affect reliability in deployed systems.
Medicine & healthcare · Experienced
Remote
Review outpatient haematology and oncology conversations to improve the accuracy of AI clinical documentation.
Medicine & healthcare · Experienced
Remote · United States
Review outpatient haematology and oncology conversations to improve the accuracy of AI clinical documentation.
Medicine & healthcare · Experienced
Remote · United States
Help a healthcare AI product assess whether clinical records support insurance coverage and medical necessity.
Medicine & healthcare · Experienced
Remote
Develop clinically rigorous scenarios and reference scoring for behavioural-health AI.
Medicine & healthcare · Expert
Remote · United States
Use pharmaceutical research experience to evaluate AI reasoning about early drug discovery and the transition from preclinical evidence to clinical development.
Medicine & healthcare · Expert
Remote · United States
Help evaluate how AI handles scientific communication, market access and commercial decisions in the pharmaceutical industry.
Medicine & healthcare · Expert
Remote · United States
Use pharmaceutical manufacturing and quality experience to evaluate AI responses about chemistry, manufacturing and controls (CMC) and good manufacturing practice.
Medicine & healthcare · Expert
Remote · United States
Help evaluate AI reasoning about medicine safety, including how it interprets adverse-event evidence and explains benefit–risk decisions.
Medicine & healthcare · Expert
Remote · United States
Bring experience in clinical trial design and delivery to the development of AI evaluation tasks.
Medicine & healthcare · Expert
Remote · United States
Help assess how AI handles pharmaceutical submission strategy, labelling and questions from health authorities.
Healthcare · Experienced
Remote
Review nutrition data and AI answers about meals, food intake and dietary habits.
Healthcare · Experienced
Remote · Japan
Review Japanese clinical histories and assess AI-generated follow-up plans for type 2 diabetes.
Medicine & Health · Experienced
Remote · Worldwide
Help evaluate how AI systems interpret medical information using your experience in clinical medicine across specialties.
Medicine & Health · Experienced
Remote · Worldwide
Help evaluate how AI systems interpret medical information using your experience in emergency and acute care.
Medicine & Health · Experienced
Remote · Worldwide
Help evaluate how AI systems interpret medical information using your experience in radiology and diagnostic imaging.
Medicine & Health · Experienced
Remote · Worldwide
Help evaluate how AI systems interpret medical information using your experience in family medicine and primary care.
Healthcare · Expert
Remote · United States
Use outpatient haematology or oncology experience to assess AI-generated clinical transcripts and notes.
Medicine & health · Expert
Remote · United States
Use your outpatient medical oncology experience to improve AI-generated transcripts and clinical notes.
Medicine & health · Expert
Remote · United States
Use your outpatient haematology experience to improve AI-generated transcripts and clinical notes.
Medicine & health · Expert
Remote · United States
Use your outpatient paediatric haematology and oncology experience to improve AI-generated transcripts and clinical notes.
Medicine & health · Expert
Remote
Bring cardiovascular prevention expertise to reviewing how AI interprets specialist clinical information.
Medicine & health · Expert
Remote
Bring advanced heart failure expertise to reviewing how AI interprets specialist clinical information.
Medicine & health · Expert
Remote
Bring cardiac electrophysiology expertise to reviewing how AI interprets specialist clinical information.
Medicine & health · Expert
Remote
Bring cardiovascular imaging expertise to reviewing how AI interprets specialist clinical information.
Medicine & health · Expert
Remote
Bring interventional cardiology expertise to reviewing how AI interprets specialist clinical information.
Healthcare · Expert
Remote · United States
Use your clinical background to assess the accuracy and safety of AI-generated health information.
Research & STEM · Experienced
Remote · United States
Use clinical documentation to improve the accuracy of AI medical-coding data.
Research & STEM · Experienced
Remote · United States
Audit clinical records and coding decisions to improve AI training quality.
Healthcare · Not specified
Remote · 17 eligible countries; see role details
Use your expertise to improve the accuracy and usefulness of AI training material involving dental and oral-health reasoning. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Data annotation & evaluation · Not specified
Remote · The United States
Lead the quality review of AI training work involving medical reasoning, clinical accuracy and patient safety. This is an application for future projects: the listing explicitly says there is no immediate assignment.
Medical & healthcare · Expert
Remote · United States
Lead senior dermatology review and help develop clinical evaluation standards for AI datasets.
Research & STEM · Expert
Remote
Apply practical nuclear and radiological security expertise to specialist AI training and evaluation work.
Medical & healthcare · Experienced
Remote
Create and evaluate realistic clinical cases, chart scenarios and healthcare benchmarks for AI.
Medicine & healthcare · Experienced
Remote · United States
Help improve AI-supported prior-authorisation workflows by checking medication-related answers for safety, accuracy and completeness.
Medicine & healthcare · Experienced
Remote · United States
Help improve AI-supported prior-authorisation workflows by checking medication-related answers for safety, accuracy and completeness.
Research & STEM · Experienced
Remote · United States
Apply inpatient nursing experience to the review of clinical AI training material.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Medical & healthcare · Expert
Remote · United States
Use specialist clinical judgement to assess health-AI answers against de-identified patient charts.
Research & STEM · Expert
Remote · London (UK) / US East Coast
Apply drug discovery expertise to challenging scientific tasks and the evaluation of AI reasoning.
Medicine & healthcare · Experienced
Remote · United States
Review inpatient coding and clinical records to improve the reliability of AI-generated medical information.
Medicine & healthcare · Experienced
Remote · United States
Apply hospital medicine experience to the accuracy and evidence behind clinical information used in AI development.
Medicine & healthcare · Experienced
Remote · United States
Check clinical coding and AI-generated medical information against professional documentation standards.
Medicine & healthcare · Experienced
Remote · United States
Use inpatient coding expertise to assess the accuracy of medical records and AI-generated clinical content.
Research & STEM · Expert
Remote · Worldwide
Apply microbiome and translational-research expertise to scientific tasks used to evaluate AI systems.
Medicine & healthcare · Experienced
Remote · Worldwide
Apply clinical experience and Korean-language expertise to assess medical content and healthcare data used in AI systems.
Medicine & healthcare · Experienced
Remote · Worldwide
Use clinical practice experience and Japanese-language expertise to improve the accuracy of AI medical content and healthcare workflows.
Medicine & healthcare · Experienced
Remote · United States
Review paediatric acute-care documentation and AI-generated summaries using your experience in emergency or urgent-care practice.
Medicine & healthcare · Experienced
Remote · Spain
Use your medical expertise and Spanish fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Spain’s local practices and terminology.
Medicine & healthcare · Experienced
Remote · Germany
Use your medical expertise and German fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in Germany’s local practices and terminology.
Medicine & healthcare · Experienced
Remote · mainland China
Use your medical expertise and Mandarin Chinese fluency to create realistic professional tasks and assess how AI agents carry them out. The work is grounded in mainland China’s local practices and terminology.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about veterans’ healthcare eligibility and access. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
Medicine & healthcare · Experienced
Remote · Worldwide
Use inpatient paediatrics expertise to check the accuracy of clinical documentation used in AI training.
Medicine & healthcare · Experienced
Remote · Worldwide
Use inpatient internal medicine expertise to check the accuracy of clinical documentation used in AI training.
Medicine & healthcare · Experienced
Remote · Worldwide
Use inpatient family medicine expertise to check the accuracy of clinical documentation used in AI training.
Medical · Experienced
Remote · United States
Help improve healthcare AI by reviewing inpatient records and applying bedside nursing judgement.
Medical · Experienced
Remote · United States
Apply primary-care expertise to evaluate clinical datasets and AI-generated healthcare content.
Medical · Experienced
Remote · United States
Evaluate health AI outputs using current clinical practice and medical judgement.
Healthcare & life sciences · Experienced
Remote
Use Cantonese and English clinical expertise to develop and assess culturally informed mental-health material for AI training.
Healthcare & life sciences · Experienced
Remote · United States
Help evaluate how AI responds to sensitive everyday discussions about relationships, emotional wellbeing, family dynamics and beliefs. The focus is balanced, supportive conversation with appropriate boundaries, rather than treating the user or giving directive clinical advice.
Healthcare & life sciences · Experienced
Remote
Review inpatient clinical records for accuracy, completeness and consistency with the patient encounter. This project uses hospitalist judgement to improve documentation reviews and the standards used to assess them.
Healthcare & life sciences · Experienced
Remote
Use Japanese and English clinical expertise to develop and assess culturally informed mental-health material for AI training.
Medicine & healthcare · Expert
Remote · all countries
Apply clinical knowledge to improve the accuracy and safety of AI-generated medical information. The projects involve careful assessment of clinical reasoning and patient-facing content.
Medicine & healthcare · Expert
Remote
Apply your medical communications experience to evaluating AI-generated scientific materials. The project needs professional judgement about accuracy, balance and how clearly information is presented to healthcare professionals or patients.
Research & STEM · Expert
Remote
Apply medical publication experience to the evaluation of AI-assisted scientific writing. You will help distinguish sound clinical interpretation from unsupported claims and give researchers clear feedback on the quality of AI-generated publication drafts.
AI training · Experienced
Remote
Apply experience in any military or professional speciality to evaluating AI-generated material.
AI training · Experienced
Remote
Apply experience in military law, operational law or human rights to evaluating AI-generated material.
AI training · Experienced
Remote
Apply experience in combat, defence or operational planning to evaluating AI-generated material.
AI training · Experienced
Remote
Apply experience in military intelligence to evaluating AI-generated material.
AI training · Experienced
Remote
Test whether social context helps an AI model give useful, personalised advice.
Law · Experienced
Remote
Use US legal research experience to check AI-generated legal analysis, citations and written arguments.
AI training · Experienced
Remote
Apply operational experience to reviewing the realism, reasoning and lawful boundaries of military AI evaluation scenarios.
Legal · Experienced
Remote
Check the sources and citations behind legal research tasks used to evaluate AI systems.
Legal · Expert
Remote
Develop and review AI evaluation material based on real civil litigation workflows.
Writing · Expert
Remote
Create and review realistic writing examples that show how experienced marketing professionals handle business, technical, academic and career-related tasks.
Business & operations · Expert
Remote · United States
Use senior marketing experience to test whether AI can produce enterprise-ready work.
AI training · Experienced
Remote
Review AI security reasoning against legitimate analytical purpose, legal authority and oversight boundaries.
Design & Creative · Expert
Remote · United States
Use professional judgement in presentation, publication and print design to create realistic benchmarks and evaluate generative AI output.
Engineering · Experienced
Remote
Create practical mechanical engineering tasks for AI evaluation in enterprise product design, manufacturing and analysis.
Engineering · Experienced
Remote
Create practical electrical engineering tasks for AI evaluation in enterprise circuit, power-system and product design.
Engineering · Experienced
Remote
Create practical civil engineering tasks for AI evaluation in infrastructure design, construction and public works.
Science · Experienced
Remote
Create and evaluate difficult quantitative problems and clear step-by-step reference reasoning.
AI training · Experienced
Remote
Apply professional expertise in military training and readiness to unclassified AI training and evaluation scenarios.
AI training · Experienced
Remote
Apply professional expertise in geopolitical and international-security analysis to unclassified AI training and evaluation scenarios.
AI training · Experienced
Remote
Apply professional expertise in national-security technology and technical programmes to unclassified AI training and evaluation scenarios.
AI training · Experienced
Remote
Apply professional expertise in special-operations and irregular-warfare assessment to unclassified AI training and evaluation scenarios.
AI training · Experienced
Remote
Apply professional expertise in signals-intelligence analytical practice to unclassified AI training and evaluation scenarios.
Design & Creative · Experienced
Remote · Worldwide
Apply design judgement to layouts, publications and branded visual work.
Design & Creative · Experienced
Remote · Worldwide
Assess and improve photographs for their intended editorial or commercial use.
Research & STEM · Expert
Remote
Assess military and federal staff reports using firsthand reporting experience.
Research & STEM · Expert
Remote · United States
Assess military and federal staff reports using firsthand reporting experience.
Research & STEM · Expert
Remote · United States
Assess military and federal staff reports using firsthand reporting experience.
Research & STEM · Experienced
Remote · United States
Apply military reporting experience to the assessment of AI staff-writing outputs.
Writing & language · Experienced
Remote
Assess and improve AI-generated Spanish (Spain) language material.
Writing & language · Experienced
Remote
Develop and assess realistic marketing writing for professional AI evaluation tasks.
Writing & language · Experienced
Remote
Assess and improve AI-generated Vietnamese language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Indonesian language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Malay language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Japanese language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Chinese language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Telugu language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Hindi language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Arabic language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Turkish language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Russian language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated German language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Portuguese language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated Spanish language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated English language material.
Writing & language · Experienced
Remote
Assess and improve AI-generated French language material.
AI training · Expert
Remote · Worldwide
Assess AI responses to threat-intelligence scenarios, including privacy and surveillance boundaries.
AI training · Expert
Remote · Worldwide
Assess AI reasoning in large-scale analytic workflows and LLM-enabled data pipelines.
Design & creative · Expert
Remote · United States
Define and evaluate colour and editorial finishing quality in generated video for an AI research team.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about Medicare enrolment and plan choices. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about veterans’ benefits and claims. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Experienced
Remote · United States
Help evaluate AI-generated information about public-benefit questions and community referrals. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
Law · Expert
Remote
Help improve AI tools that support legal advocacy by bringing practical litigation judgement to a part-time fellowship. You will work through realistic legal exercises and assess whether AI responses reflect persuasive writing, sound reasoning and effective litigation strategy.
Writing & language · Experienced
Remote
Bring assessment experience to the review of AI-generated writing. You will compare responses, apply scoring criteria and explain whether the writing is accurate, useful and appropriate for its intended audience.
AI training · Entry level
Remote · United States
Use original images you can submit to assess how faithfully an AI system recreates visual details.
AI training · Entry level
Remote · Worldwide
Use your personal ChatGPT account to compare AI assistants in everyday conversations and explain which experience worked better.
AI training · Entry level
Remote · United States
Rate AI assistant responses from the perspective of an active everyday user.
AI training · Entry level
Remote
Assess AI personalisation using selected context from your own Google and Samsung-phone activity.
AI training · Entry level
Remote · United States
Help evaluate AI-generated information about the clarity and usefulness of government-service answers. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
AI training · Entry level
Remote · United States
Help evaluate AI-generated information about the clarity of government-service answers in Spanish and English. Your feedback will help the project distinguish accurate, useful guidance from unclear or misleading answers.
BEFORE YOU APPLY
An AI evaluator reviews a model’s work against task instructions and scoring criteria. Depending on the role, you may compare answers, check facts, test generated code, assess images or review specialist reasoning. Useful feedback identifies the issue and the evidence behind the score.
Some roles accept transferable experience in writing, research, quality assurance or another professional field. That does not remove mandatory requirements such as an active clinical licence, a particular language, relevant professional experience or residence in an eligible country. Check the individual role.
Many opportunities support remote work, but remote does not mean open worldwide. Each role shows its location rules. Check country restrictions, work authorisation, equipment and required time-zone overlap before applying.
Payment can be hourly or per accepted task. The rate and pay basis belong to the individual listing; they are not a guaranteed salary or weekly income. Read the working arrangements for hours, project length, payment conditions and any information the listing does not provide.
Apply through Find Jobs in AI using your profile and CV. Our team reviews your application and contacts you about the next steps if you are a good fit. A profile or application is not a guarantee of an assignment.