Remote AI Agent Evaluator Position

3 hours ago

Montreal, Quebec, Canada YO AI Labs Full-time
Elevate enterprise AI training as a remote AI Agent Evaluator. Utilize your hands-on experience with AI tools to test workflows and provide valuable feedback for improvements. We are looking for AI Agent Power Users who can run multi-step business workflows using AI assistants like ChatGPT and Claude. In this contractor role, you will assess AI performance in real-world scenarios, provide structured evaluations, and help enhance AI utility across various platforms. A strong focus on documentation and actionable insights is essential in this position.

Key Responsibilities
• Test complex business workflows with AI assistants
• Document performance and identify improvement areas
• Evaluate AI outputs against defined rubrics
• Provide actionable feedback to AI teams
• Connect AI tools with popular workplace platforms

Requirements:
• 5+ years in a tech-related business role
• Bachelor’s degree in any field
• Hands-on experience with ChatGPT or Claude
• Familiarity with evaluation frameworks
• Excellent documentation skills in English Leverage your AI expertise and business acumen to impact enterprise workflows positively.