Find Jobs in AI All opportunities
Open for applicationsAI training

AI Agent Evaluator — Everyday Tasks

Open role
Pay
$25–$45 / hour
Location
Remote · United States
Experience level
Experienced

A CLOSER LOOK

Explore the opportunity

01 / THE DETAILS

Role overview

Get to know the opportunity

Compare two AI agents carrying out everyday phone-based tasks and document how each performs.

02 / THE DETAILS

What you’ll be doing

Your day-to-day contribution
  • Run supplied scenarios using your own accounts and approve or stop key steps.
  • Screen-record attempts and score completion, quality, control and time.
  • Write clear feedback describing what worked and where the experience failed.
03 / THE DETAILS

Who this could suit

See where your experience could fit

US-based generalists who already use AI tools and can follow instructions carefully.

04 / THE DETAILS

What you’ll need

Experience, skills and essential requirements
  • US residence, a bachelor’s degree and two to three years of experience are requested, preferably in engineering, business or operations.
  • You need a smartphone that can record its screen and an active personal AI account on a supported Free, Go or Plus tier rather than Pro.
  • Clear writing and detailed records are important; coding experience is not required.

You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills.

05 / THE DETAILS

Pay and working arrangements

Rates, commitment and working arrangements

$25–$45 per hour for remote contractor work. Runs are estimated at around 1.5 hours including evidence and scoring. The active listing still contains inconsistent October kickoff and onboarding dates; obtain the current schedule during selection. Weekly hours and payment timing are not specified.

06 / THE DETAILS

What happens next

How to move forward

Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps. Later review includes questions, a 15–30 minute interview, profile review and onboarding.

Practice for this role

Check an AI answer against a source

Notice: “Returns are accepted within 30 days with a receipt. Opened software is excluded.” AI answer: “You can return any item within 45 days without a receipt.”

Identify the errors and write a corrected answer using the notice.

Sign in for private feedback or work through the example below.

See the rubric and example answer
  • Time limit · Correct 45 days to 30 days.
  • Receipt requirement · State that a receipt is required.
  • Exception · State that opened software is excluded.

Returns are accepted within 30 days with a receipt. Opened software is excluded.

Application checklist
Requirements from the listing

US residence, a bachelor’s degree and two to three years of experience are requested, preferably in engineering, business or operations. You need a smartphone that can record its screen and an active personal AI account on a supported Free, Go or Plus tier rather than Pro. Clear writing and detailed records are important; coding experience is not required.

Sign in to check your saved CV.

Pay$25–$45 / hour
Continue to apply