Senior/Staff Code Review Experts

4 days ago

Toronto, Ontario, Canada Mercor Full time $800,000 - $1,000,000 per year

Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We're seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term, fully remote engagement helps shape the future of developer-assisting AI systems.

Key Responsibilities


• Review long-form transcripts between users and AI coding assistants


• Analyze the AI's logic, execution, and stated actions in detail


• Score each transcript using a 10-point rubric across multiple criteria


• Optionally write brief justifications citing examples from the dialogue


• Detect mismatches between claims and actions (e.g., saying "I'll run tests" but not doing so)

Ideal Qualifications

Top choices:


• Senior or Staff Engineers with deep code review experience and execution insight


• QA Engineers with strong verification and consistency-checking habits


• Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation

Also a strong fit:


• Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows


• DevOps or SRE professionals familiar with tool orchestration and system behavior analysis

Languages and Tools:


• Proficiency in Python is helpful (most transcripts are Python-based)


• Familiarity with other languages like JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus


• Comfort with Git workflows, testing frameworks, and debugging tools is valuable

More About the Opportunity


• Remote and asynchronous — complete tasks on your own schedule


• Must complete each transcript batch within 5 hours of starting (unlimited tasks to be done)


• Flexible, task-based engagement with potential for recurring batches

Compensation & Contract Terms


• Competitive hourly rates based on geography and experience


• Contractors will be classified as independent service providers


• Payments issued weekly via Stripe Connect

Application Process


• Submit your resume to begin


• If selected, you'll receive rubric documentation and access to the evaluation platform


• Most applicants hear back within a few business days

About Mercor


• Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations


• Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey


• Thousands of professionals across law, engineering, and research contribute to frontier AI projects via Mercor

  • Expert Reviewer

    2 weeks ago

    Toronto, Ontario, Canada Mercor Full time $50,000 - $84,000 per year

    1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...

  • Senior Implementation Code Consultant

    7 days ago

    Toronto, Ontario, Canada Clariti Cloud Inc. Full time $85,000 - $120,000 per year

    Join our mission to provide governments with exceptional experiences so they can do the same for their communitiesWhat do we do?We empower governments to deliver exceptional citizen experiences.Check out our 'About Us'page for a deep dive into our product and what makes us exceptional.CivCheck is transforming how cities manage plan review and building code...

  • Senior Implementation Code Consultant

    1 week ago

    Toronto, Ontario, Canada Clariti Full time $85,000 - $120,000 per year

    Join our mission to provide governments with exceptional experiences so they can do the same for their communitiesWhat do we do?We empower governments to deliver exceptional citizen experiences.Check out our'About Us'page for a deep dive into our product and what makes us exceptional.CivCheckis transforming how cities manage plan review and building code...

  • Senior Full Stack Developer

    6 days ago

    Toronto, Ontario, Canada Source Code Full time $120,000 - $180,000 per year

    Senior Full Stack Engineer (C#.Net, Angular 5+, Azure)Toronto, ONFully Remote1-year contract with the possibility of extensionDesign and develop elegant and accessible front-end solutions which are end-to end: from technical analysis and data architecture, through to unit testing, development, and integration testing.Provide mentorship to less experienced...

  • Staff or Senior Software Engineer

    9 hours ago

    Toronto, Ontario, Canada hireVouch Full time US$125,000 - US$175,000 per year

    Job Title: Staff (or Senior) Software Engineer (Backend - )Location: Toronto, Canada (Remote)Our client is a California-based company at the forefront of Artificial Intelligence, dedicated to delivering innovative solutions that empower businesses and individuals. They are seeking a seasoned Staff  (or Senior) Software Engineer to join their team. Their...

  • RQ09803 - Sr. Applications Architect

    1 week ago

    Toronto, Ontario, Canada Source Code Full time $80,000 - $120,000 per year

    RQ Sr. Applications Architect 3-month contract, possible extension Land & Resources Cluster - Ministry of Public and Business Service Delivery and Procurement Candidate can work remotely, however, may be required to come to office as needed. To respond to the priorities of the Government of Ontario through the passage of the Bill 5, Protect Ontario by...

  • Rq09803

    5 days ago

    Toronto, Ontario, Canada Source Code Full time $80,000 - $140,000 per year

    RQ Sr. Applications Architect3-month contract, possible extensionLand & Resources Cluster - Ministry of Public and Business Service Delivery and ProcurementCandidate can work remotely, however, may be required to come to office as needed.To respond to the priorities of the Government of Ontario through the passage of the Bill 5, Protect Ontario by...

  • Senior Advisor, Compliance Review

    1 week ago

    Toronto, Ontario, Canada 5ec8a4b5-2993-42e6-ae1b-b8f2bb673a45 Full time $80,000 - $120,000 per year

    Organization:Information and Privacy Commissioner of Ontario (IPC)Division:Office of the Assistant Commissioner, Strategic Initiatives and External RelationsCity:TorontoJob Term:18 monthsJob Code:237346Salary:$88,496 to $128,625Posting Status:OpenMake an Impact Where It MattersAre you passionate about strengthening public trust, protecting privacy, and...

  • Senior Staff Accountant

    7 days ago

    Toronto, Ontario, Canada Winchesters Full time $85,000 - $100,000 per year

    Senior Staff AccountantToronto, ON - in office$85,000-$100,000 base and great benefitsOur client is a public accounting firm located in Toronto and they are seeking a senior staff accountant with his/her CPA completed or actively pursuing it. The continued growth of the team's assurance practice has led to the opportunity for a motivated intermediate or...

  • Front End Engineer

    7 days ago

    Toronto, Ontario, Canada Source Code Full time $100,000 - $180,000 per year

    Front End Engineer (JavaScript, C#.Net, Angular 5)Toronto, ONFully Remote1-year contract with the possibility of extensionDesign and develop elegant and accessible front-end solutions which are end-to end: from technical analysis and data architecture, through to unit testing, development, and integration testing.Choose appropriate design patterns and...