AI Evaluation Strategy Expert
20 hours ago
Winnipeg, Manitoba, Canada
Telus Digital AI Solution
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor. Define how systems reason across cultures.
As an AI strategy expert, you will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback and consistent, helpful AI personas. You will collaborate with stakeholders on response profiles for industries and user personas.
Key Responsibilities:
Draft multi-dimensional rubrics for tone, logic, and instruction following Lead quality-assurance audits for large-scale annotation projects Investigate hallucinations and logical fallacies in model outputs Develop prompt-engineering strategies to mitigate model issues Define Ideal Response Profiles with project stakeholders Requirements:
Bachelor’s Degree in technical or humanities discipline Minimum B1 intermediate English proficiency Native-level fluency in at least one language Exceptional writing and logic-based decision-making skills Successful qualification exam and completed ID verification Apply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
Draft multi-dimensional rubrics for tone, logic, and instruction following Lead quality-assurance audits for large-scale annotation projects Investigate hallucinations and logical fallacies in model outputs Develop prompt-engineering strategies to mitigate model issues Define Ideal Response Profiles with project stakeholders Requirements:
Bachelor’s Degree in technical or humanities discipline Minimum B1 intermediate English proficiency Native-level fluency in at least one language Exceptional writing and logic-based decision-making skills Successful qualification exam and completed ID verification Apply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.