AI Conversation Evaluation Specialist

Role overview Help assess whether an AI assistant understands enough about a person's situation before giving advice. You’ll review conversations and identify the questions the assistant should have asked. What you’ll be doing • Read conversations about everyday decisions and interpersonal situations. • Identify missing context and useful follow-up questions. • Explain whether the missing information could change the recommendation. • Record your findings using structured evaluation guidance. Who this could suit Experienced professionals in social work, counselling, psychology, qualitative research, HCI, communication, mediation, coaching, student services or related advisory work. What you’ll need You must be based in the United States, Canada or Western Europe. The role calls for roughly 3–5 years of relevant direct practice and suitable qualifications, credentials or demonstrated expertise in one of the fields above. The source sets specific graduate-degree and licence requirements for clinical social-work and counselling routes; research and advisory routes require the corresponding advanced expertise or substantial direct experience. You don’t have to match every requirement exactly. We welcome applicants with different backgrounds, levels of experience and transferable skills. Pay and working arrangements Remote, full-time contractor project expected to run for three weeks. Payment is per task, with tasks estimated at about 75 minutes; the source does not state a task fee. The estimated project start is 1 October 2026. What happens next Apply through Find Jobs in AI with your profile and CV. We’ll review your application and, if you’re a good fit, we’ll be in touch about the next steps.