Senior/Staff Code Review Experts

1 week ago

Toronto, Canada Mercor Full time

Senior/Staff Code Review Experts role at Mercor Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts, especially those with experience in code review, testing, or documentation, to assess full transcripts of user–AI coding conversations. This short‑term, fully remote engagement helps shape the future of developer‑assisting AI systems. Key Responsibilities Review long‑form transcripts between users and AI coding assistants Analyze the AI’s logic, execution, and stated actions in detail Score each transcript using a 10‑point rubric across multiple criteria Optionally write brief justifications citing examples from the dialogue Detect mismatches between claims and actions (e.g., saying “I’ll run tests” but not doing so) Ideal Qualifications Senior or Staff Engineers with deep code review experience and execution insight QA Engineers with strong verification and consistency‑checking habits Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation Other Strong Fits Backend or Full‑Stack Developers comfortable with function calls, APIs, and test workflows DevOps or SRE professionals familiar with tool orchestration and system behavior analysis Languages and Tools Proficiency in Python (most transcripts are Python‑based) Familiarity with other languages such as JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus Comfort with Git workflows, testing frameworks, and debugging tools is valuable More About the Opportunity Remote and asynchronous — complete tasks on your own schedule Must complete each transcript batch within 5 hours of starting (unlimited tasks to be done) Flexible, task‑based engagement with potential for recurring batches Compensation & Contract Terms Competitive hourly rates based on geography and experience Contractors will be classified as independent service providers Payments issued weekly via Stripe Connect Application Process Submit your resume to begin If selected, you’ll receive rubric documentation and access to the evaluation platform Most applicants hear back within a few business days About Mercor Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey Thousands of professionals across law, engineering, and research contribute to frontier AI projects via Mercor #J-18808-Ljbffr

  • Senior/Staff Code Review Experts

    1 week ago

    Toronto, Canada Mercor Full time

    Senior/Staff Code Review Experts role at MercorMercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts, especially those with experience in code review, testing, or documentation, to assess full transcripts of...

  • Senior Code Review Expert

    1 week ago

    Toronto, Canada Mercor Full time

    A leading AI research talent marketplace is seeking Senior/Staff Code Review Experts to evaluate coding assistants' reasoning and communication. The role involves reviewing transcripts, analyzing AI logic, and scoring performance. Ideal candidates have extensive experience in code review or QA and familiarity with Python or similar languages. This is a fully...

  • Senior Code Review Expert

    1 week ago

    Toronto, Canada Mercor Full time

    A leading AI research talent marketplace is seeking Senior/Staff Code Review Experts to evaluate coding assistants' reasoning and communication. The role involves reviewing transcripts, analyzing AI logic, and scoring performance. Ideal candidates have extensive experience in code review or QA and familiarity with Python or similar languages. This is a fully...

  • Expert Reviewer

    2 weeks ago

    Toronto, Canada Mercor Full time

    1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...

  • Expert Reviewer

    2 weeks ago

    Toronto, Canada Mercor Full time

    1. Role Overview Mercor is seeking highly skilled expert reviewers to support a leading AI research initiative focused on evaluating and improving large-scale text outputs. This short-term, remote opportunity involves critically reviewing written material to identify logical inconsistencies, inaccuracies, or unclear reasoning. Ideal candidates will have...

  • Supervisor Plan Review

    1 week ago

    Toronto, Canada City of Toronto Full time

    **Job ID**: 56551 **Job Category**:Audit, Compliance & Inspections **Division & Section**:Toronto Building, Tor Bldg Etobicoke York District **Work Location**:Multiple Locations (see below) **Job Type & Duration**:Full-Time, Permanent **Salary**:$103,431.00 - $141,247.00, TM5324 and wage grade 7. **Shift Information**: Monday to Friday, 35 hours per...

  • Senior Full Stack Developer

    1 week ago

    Toronto, Ontario, Canada Source Code Full time

    Senior Full Stack Engineer (C#.Net, Angular 5+, Azure)Toronto, ONFully Remote1-year contract with the possibility of extensionDesign and develop elegant and accessible front-end solutions which are end-to end: from technical analysis and data architecture, through to unit testing, development, and integration testing.Provide mentorship to less experienced...

  • RQ09935 - DevOPS/Cloud Engineer - Senior

    3 weeks ago

    Toronto, Canada Source Code Full time

    RQ09935 - DevOPS/Cloud Engineer - Senior 1 year, 4 month contract, possible extension ONSITE - 87 Sirst Ave., Toronto, Ontario M3M 0B4 2 Openings - 2 submissions Task 1 Monthly Performance Status Report (where applicable) Deliverables All deliverables that consultant worked on during past month are included Progress and specific accomplishment against the...

  • Senior Staff Product Designer

    3 weeks ago

    Toronto, Canada Questrade Financial Group Full time

    4 days ago Be among the first 25 applicants Get AI‑powered advice on this job and more exclusive features. Direct message the job poster from Questrade Financial Group Questrade Financial Group (QFG), through its companies – Questrade, Inc., Questrade Wealth Management Inc., Community Trust Company, Zolo, and Flexiti Financial Inc. – provides...

  • RQ10110 - Senior Dynamics CRM Software Developer - Full Stack

    2 weeks ago

    Toronto, Canada Source Code Full time

    RQ10110 - Senior Dynamics CRM Software Developer - Full Stack 1-year, 3-month contract  ONSITE - 222 Jarvis, Toronto, ON Government Services Integration Cluster - Ministry of Public and Business Service Delivery and Procurement Responsible for managing the interchange of data between the server and the users. Required to translate technical systems...