Find Jobs in AI All opportunities
Open for applicationsAI training

US Generalist Rater — Personalised AI Evaluation

Open role
Pay
Contractor project · rate not provided
Location
Remote · United States
Experience level
Experienced

A CLOSER LOOK

Explore the opportunity

01 / THE DETAILS

Role overview

Get to know the opportunity

Evaluate personalised AI responses using context from your connected Google accounts.

02 / THE DETAILS

What you’ll be doing

Your day-to-day contribution
  • Test retrieval prompts and compare response relevance and accuracy.
  • Identify unsupported assumptions, incorrect personalisation and missed context.
  • Write reasoned ratings while following project privacy and confidentiality requirements.
03 / THE DETAILS

Who this could suit

See where your experience could fit

People with relevant practical expertise who can follow detailed instructions and explain their decisions clearly.

04 / THE DETAILS

What you’ll need

Experience, skills and essential requirements
  • You must currently be based in the United States, actively use Google apps with sufficient history, and be willing to connect apps such as Gmail, Photos, Calendar and Drive.
  • Relevant personal and professional account context may be used.
  • A bachelor’s degree or equivalent practical experience, strong analytical English, attention to detail and a desktop/laptop with reliable internet are required.
  • Prior AI evaluation experience is preferred, not mandatory.
  • App permissions, consent forms and confidentiality agreements are required for participation.

You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.

05 / THE DETAILS

Pay and working arrangements

Rates, commitment and working arrangements

Remote contractor engagement for up to sixteen weeks. The source requests at least four hours a day, up to forty hours a week and four hours overlapping Pacific time. No numeric pay is provided.

06 / THE DETAILS

What happens next

How to move forward

Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps. Shortlisted candidates complete an interest form; selected participants receive consent, contracting and onboarding instructions.

Practice for this role

Check an AI answer against a source

Notice: “Returns are accepted within 30 days with a receipt. Opened software is excluded.” AI answer: “You can return any item within 45 days without a receipt.”

Identify the errors and write a corrected answer using the notice.

Sign in for private feedback or work through the example below.

See the rubric and example answer
  • Time limit · Correct 45 days to 30 days.
  • Receipt requirement · State that a receipt is required.
  • Exception · State that opened software is excluded.

Returns are accepted within 30 days with a receipt. Opened software is excluded.

Application checklist
Requirements from the listing

You must currently be based in the United States, actively use Google apps with sufficient history, and be willing to connect apps such as Gmail, Photos, Calendar and Drive. Relevant personal and professional account context may be used. A bachelor’s degree or equivalent practical experience, strong analytical English, attention to detail and a desktop/laptop with reliable internet are required. Prior AI evaluation experience is preferred, not mandatory. App permissions, consent forms and confidentiality agreements are required for participation.

Sign in to check your saved CV.

PayContractor project · rate not provided
Continue to apply