Remote Senior AI Engineer: GenAI Evaluation Frameworks

2 weeks ago


Toronto Montreal Calgary Vancouver Edmonton Old Toronto Ottawa Mississauga Quebec Winnipeg Halifax Saskatoon Burnaby Hamilton Surrey Victoria London Halton Hills Regina Markham Brampton Vaughan Kelowna Laval Southwestern Ontario R, Canada Grafana Labs Full time

A leading observability tools company is seeking a Senior Engineer specializing in Generative AI and ML Evaluation Frameworks. This remote position focuses on designing evaluation frameworks and scaling automated pipelines for AI systems. Ideal candidates should have experience in Generative AI evaluation, collaborative problem-solving skills, and a passion for building efficient AI-supported systems. A competitive compensation range is offered for Canadian applicants.
#J-18808-Ljbffr



  • Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Grafana Labs Full time

    This is a remote opportunity and we would be interested in applicants from Canada time zones only at this time. Senior Engineer – GenAI & ML Evaluation Frameworks At Grafana, we build observability tools that help users understand, respond to, and improve their systems – regardless of scale, complexity, or tech stack. The Grafana AI teams play a key role...


  • Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada iMerit Technology Full time

    A technology evaluation company is seeking a Multimodal GenAI Evaluation Analyst in Canada. The role involves evaluating AI system outputs and assessing quality across text, images, and videos. Candidates should have at least 1 year of experience in data annotation or related AI/ML fields and need strong analytical skills. The company offers competitive...

  • AI Evaluation Expert

    2 weeks ago


    Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Taskify AI Full time

    AI Evaluation Expert (Remote) – Taskify AI Join a worldwide community of skilled professionals outsmarting AI with human creativity and analytical brilliance. As a Data Contributor, you will directly influence the quality and safety of cutting‑edge language models, including collaborations with industry-standard partners. Salary and Compensation Earn up...


  • Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada VeUP Full time

    Job Title: Senior Solutions Architect (AWS/GenAI) Salary: $140-$170,000 CAD + Variable Bonus:25%of base On-Target Earnings (OTE):CAD$175,000 – $212,500 Contract Type: Full-time, Fixed Term Start Date: ASAP About VeUP At VeUP, we go beyond cloud consulting, we are the growth engine for startups, ISVs, and enterprises looking to scale smarter and maximize...


  • Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Taskify AI Full time

    Literature Evaluator (Remote) – Taskify AI Pay: Competitive monthly compensation up to $10,000, based on role and performance. We’re looking for detail‑oriented professionals to support a variety of content and AI‑related evaluation tasks. This role involves reviewing written material, analysing responses, and helping enhance the quality, accuracy,...

  • Writing Evaluator

    1 week ago


    Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Taskify AI Full time

    Join to apply for the Writing Evaluator (Remote) role at Taskify AI 1 day ago Be among the first 25 applicants Pay: Competitive monthly compensation up to $10,000, based on role and performance We’re looking for detail-oriented professionals to support a variety of content and AI-related evaluation tasks. This role involves reviewing written material,...


  • Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Taskify AI Full time

    Join to apply for the Nutrition Quality Evaluator (Remote) role at Taskify AI We are looking for certified nutrition professionals to support AI training by creating and evaluating high‑quality clinical nutrition content. This remote role offers flexible weekly hours and the opportunity to contribute to the development of safe, reliable AI systems. Pay:...

  • AI Evaluator

    4 weeks ago


    Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Braintrust Full time

    Join to apply for the AI Evaluator / Annotator (Remote‑freelance, 100+ openings) role at Braintrust. Position Overview iMerit seeks detail‑oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts...


  • Montreal, Toronto, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Syntax Full time

    A technology company in Montreal is seeking a full-time Gen AI Developer to join a growing team focused on innovative GenAI-based solutions. The role involves building tailored solutions using the Syntax GenAI Stack, collaborating with customers, and delivering effective results with a strong emphasis on Python and GenAI frameworks. This position offers a...


  • Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Jobgether Full time

    This position is posted by Jobgether on behalf of a partner company. We are currently looking for a [Senior iOS Engineer II, Maps Framework] in [Canada]. As a Senior iOS Engineer II specializing in maps frameworks, you will own the development and evolution of the core mapping layer for a high-scale mobile application. You will design and implement modular,...