Ai Evaluation Strategy Expert

5 days ago

Winnipeg MB, Winnipeg Census Division, MB; Manitoba, Canada Telus Digital AI Solution Full-time
Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor. Define how systems reason across cultures.
As an AI strategy expert, you will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback and consistent, helpful AI personas. You will collaborate with stakeholders on response profiles for industries and user personas.

Key Responsibilities

Draft multi-dimensional rubrics for tone, logic, and instruction followingLead quality-assurance audits for large-scale annotation projectsInvestigate hallucinations and logical fallacies in model outputsDevelop prompt-engineering strategies to mitigate model issuesDefine Ideal Response Profiles with project stakeholdersRequirements:
Bachelor’s Degree in technical or humanities disciplineMinimum B1 intermediate English proficiencyNative-level fluency in at least one languageExceptional writing and logic-based decision-making skillsSuccessful qualification exam and completed ID verificationApply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
#J-18808-Ljbffr