Senior Data Scientist
3 days ago
Montreal administrative region, QC, Canada
RBC
Full-time
$120,000 - $180,000 Contract
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Lead the charge in AI evaluation as a Senior Data Scientist for RBC's AI Group. You will facilitate trusted AI capabilities through innovative evaluation methodologies and technical mentorship.
As a Staff Data Scientist specializing in AI Evaluations, you will take on a senior role in shaping how RBC evaluates model quality and performance. You will design and improve evaluation datasets, quality benchmarks, and methodologies that will transition AI systems into reliable production. Your work will involve collaborating with multiple teams to ensure comprehensive evaluation integration throughout the AI development lifecycle.
Key Responsibilities
• Drive advanced evaluation methodologies including datasets and rubrics
• Define measurable criteria for model risk and product quality
• Own lifecycle processes for evaluation datasets and scorecards
• Partner with teams to embed evaluations into release workflows
• Establish protocols for human evaluation and data quality
Requirements:
• 8+ years in data science or AI evaluation
• Strong experience with evaluation frameworks for ML and AI systems
• Practical knowledge of LLM evaluation methods
• Proficiency in Python, SQL, and AI/ML practices
• Excellent communication and stakeholder management skills Enhance RBC's AI capabilities through your expertise in model evaluation and mentorship while driving forward the field of responsible AI.
Key Responsibilities
• Drive advanced evaluation methodologies including datasets and rubrics
• Define measurable criteria for model risk and product quality
• Own lifecycle processes for evaluation datasets and scorecards
• Partner with teams to embed evaluations into release workflows
• Establish protocols for human evaluation and data quality
Requirements:
• 8+ years in data science or AI evaluation
• Strong experience with evaluation frameworks for ML and AI systems
• Practical knowledge of LLM evaluation methods
• Proficiency in Python, SQL, and AI/ML practices
• Excellent communication and stakeholder management skills Enhance RBC's AI capabilities through your expertise in model evaluation and mentorship while driving forward the field of responsible AI.