Remote AI Agent Evaluator Position
3 hours ago
Montreal, Quebec, Canada
YO AI Labs
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Elevate enterprise AI training as a remote AI Agent Evaluator. Utilize your hands-on experience with AI tools to test workflows and provide valuable feedback for improvements.
We are looking for AI Agent Power Users who can run multi-step business workflows using AI assistants like ChatGPT and Claude. In this contractor role, you will assess AI performance in real-world scenarios, provide structured evaluations, and help enhance AI utility across various platforms. A strong focus on documentation and actionable insights is essential in this position.
Key Responsibilities
• Test complex business workflows with AI assistants
• Document performance and identify improvement areas
• Evaluate AI outputs against defined rubrics
• Provide actionable feedback to AI teams
• Connect AI tools with popular workplace platforms
Requirements:
• 5+ years in a tech-related business role
• Bachelor’s degree in any field
• Hands-on experience with ChatGPT or Claude
• Familiarity with evaluation frameworks
• Excellent documentation skills in English Leverage your AI expertise and business acumen to impact enterprise workflows positively.
Key Responsibilities
• Test complex business workflows with AI assistants
• Document performance and identify improvement areas
• Evaluate AI outputs against defined rubrics
• Provide actionable feedback to AI teams
• Connect AI tools with popular workplace platforms
Requirements:
• 5+ years in a tech-related business role
• Bachelor’s degree in any field
• Hands-on experience with ChatGPT or Claude
• Familiarity with evaluation frameworks
• Excellent documentation skills in English Leverage your AI expertise and business acumen to impact enterprise workflows positively.