Remote AI Design Evaluator

DataAnnotation is seeking an experienced Electrical Engineer to guide frontier AI models in evaluating real electrical engineering tasks. The role leverages your design judgment, debugging, and hardware experience to teach AI systems to reason about circuits, power stages, and physical constraints.You will design engineering problems, test them with frontier...

Mercor is seeking a UI/UX Design Expert for a remote contract role focused on grading criteria for digital product UX and AI evaluation. The position requires independence and the ability to work asynchronously.You will score AI-generated and human work samples, provide detailed written justifications, and iteratively improve scores with senior reviewers....

AI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

Workada is seeking a detail-oriented evaluator to review AI outputs across text, images, video and documents, applying detailed criteria and writing clear judgments. You should write well, think critically, and follow guidelines independently. This remote, full-time role offers training, feedback, and opportunities to grow with a mission-driven team....

YO AI Labs is seeking experienced Technical Writers / Editors to contribute to a customer project evaluating and improving AI systems. This contractor role supports remote collaboration with project managers and reviewers. You will write, edit, and critically analyze AI-generated content, provide scores and rationale, and suggest actionable improvements...

Elevate enterprise AI training as a remote AI Agent Evaluator. Utilize your hands-on experience with AI tools to test workflows and provide valuable feedback for improvements. We are looking for AI Agent Power Users who can run multi-step business workflows using AI assistants like ChatGPT and Claude. In this contractor role, you will assess AI performance...

Alignerr is seeking a Nursing Informatics Specialist for AI training on a fully remote, hourly contract basis. The role leverages clinical experience to evaluate AI-generated content and workflows, ensuring accuracy and real-world applicability.You will contribute expert feedback to improve AI model quality in healthcare contexts. Ideal candidates are...

Partner company seeks an Electrical Engineering Expert for a fully remote, part-time contract in Canada. You will design and evaluate AI-driven engineering tasks, focusing on circuit design, PCB layouts, and validation of calculations through simulations.Responsibilities include creating realistic tasks, reviewing schematics, selecting components, and...

Mercor is seeking expert Evaluators in Healthcare operations to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. This is a remote, hourly engagement.You will apply deep subject-matter expertise to grade outputs and identify factual, presentation, and aesthetic errors, delivering...