Remote AI Agent Evaluator Position

Workada is seeking a remote, full-time evaluator to help improve AI systems by assessing outputs across text, images, video and documents against detailed criteria.You will identify errors, note inconsistencies, and write clear, well-reasoned judgments that aid model accuracy in real-world use.Strong reading and writing skills, sharp judgment, and the...

Workada is seeking a detail-oriented evaluator to improve AI systems by reviewing outputs from text, images, video, and documents against clear criteria, identifying gaps, and writing clear, well-reasoned judgments.In a remote, full-time role, you'll follow documented guidelines, maintain consistency, and help our systems become more accurate and reliable,...

Workada is seeking a remote, full-time AI evaluator to review outputs from models across text, images, and video for a 3 to 6 month period. You will apply detailed criteria, identify errors, and provide clear justifications to help improve system accuracy and reliability.Ideal candidates are strong readers and writers with sound judgment, who can follow...

AI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

Workada is seeking detail-oriented evaluators to assess AI model outputs across text, images, video, and documents. You will apply detailed criteria, identify errors, and provide clear, justification for judgments. Your evaluations help improve accuracy and reliability of our data labeling.This is a remote, full-time role. Ideal candidates are strong readers...

RWS invites linguists to join as AI Linguistic Evaluators to assess Bengali content for an AI project. This remote freelance role from Canada offers flexible hours and an immediate start.You will translate prompts, interact with AI, and evaluate responses for linguistic accuracy and cultural relevance. Ideal candidates have Bengali (India) fluency, strong...

Join Gramian Consultancy as a Remote AI Personalization Evaluator specializing in Google applications based in Canada. Assess AI model responses while working flexibly from home.In this contractor role, you will support the Gemini Personalization Evals project by evaluating AI's effectiveness in using relevant context from Gmail, Google Calendar, and other...

We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration.Job Type: FreelanceLocation: Remote from CanadaWork Schedule: FlexibleStart Date: ImmediatelyDuration: Approximately 10-15 total hours (around 5 hours per day)Rate: 16 USD/hourEquipment Required: Access to at least one...

YO AI Labs is seeking an AI Evaluation Specialist to assess and improve AI assistant outputs for an enterprise training project. This remote contractor role focuses on applying rubrics for accuracy, relevance, and adherence to guidelines, with feedback that informs system improvements.You will work independently on large datasets, identify gaps, document...