Senior/Staff Code Review Experts
2 weeks ago
Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term, fully remote engagement helps shape the future of developer-assisting AI systems. Key Responsibilities • Review long-form transcripts between users and AI coding assistants • Analyze the AI’s logic, execution, and stated actions in detail • Score each transcript using a 10-point rubric across multiple criteria • Optionally write brief justifications citing examples from the dialogue • Detect mismatches between claims and actions (e.g., saying “I’ll run tests” but not doing so) Ideal Qualifications Top choices: • Senior or Staff Engineers with deep code review experience and execution insight • QA Engineers with strong verification and consistency-checking habits • Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation Also a strong fit: • Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows • DevOps or SRE professionals familiar with tool orchestration and system behavior analysis Languages and Tools: • Proficiency in Python is helpful (most transcripts are Python-based) • Familiarity with other languages like JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus • Comfort with Git workflows, testing frameworks, and debugging tools is valuable More About the Opportunity • Remote and asynchronous — complete tasks on your own schedule • Must complete each transcript batch within 5 hours of starting (unlimited tasks to be done) • Flexible, task-based engagement with potential for recurring batches Compensation & Contract Terms • Competitive hourly rates based on geography and experience • Contractors will be classified as independent service providers • Payments issued weekly via Stripe Connect Application Process • Submit your resume to begin • If selected, you’ll receive rubric documentation and access to the evaluation platform • Most applicants hear back within a few business days About Mercor • Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations • Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey • Thousands of professionals across law, engineering, and research contribute to frontier AI projects via Mercor
-
Senior/Staff Code Review Experts
1 week ago
Toronto, Canada Mercor Full timeSenior/Staff Code Review Experts role at Mercor Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts, especially those with experience in code review, testing, or documentation, to assess full transcripts of...
-
Senior/Staff Code Review Experts
1 week ago
Toronto, Canada Mercor Full timeSenior/Staff Code Review Experts role at MercorMercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts, especially those with experience in code review, testing, or documentation, to assess full transcripts of...
-
Senior/Staff Code Review Experts
2 weeks ago
Toronto, Canada Mercor Full timeMercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term,...
-
Senior/Staff Code Review Experts
2 weeks ago
Toronto, Ontario, Canada Mercor Full time $800,000 - $1,000,000 per yearMercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We're seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term,...
-
Senior Code Review Expert
1 week ago
Toronto, Canada Mercor Full timeA leading AI research talent marketplace is seeking Senior/Staff Code Review Experts to evaluate coding assistants' reasoning and communication. The role involves reviewing transcripts, analyzing AI logic, and scoring performance. Ideal candidates have extensive experience in code review or QA and familiarity with Python or similar languages. This is a fully...
-
Senior Code Review Expert
1 week ago
Toronto, Canada Mercor Full timeA leading AI research talent marketplace is seeking Senior/Staff Code Review Experts to evaluate coding assistants' reasoning and communication. The role involves reviewing transcripts, analyzing AI logic, and scoring performance. Ideal candidates have extensive experience in code review or QA and familiarity with Python or similar languages. This is a fully...
-
Senior Code Reviewer for LLM Data Training
3 weeks ago
Toronto, Canada G2i Inc. Full timeAbout the Company G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly upon approval, ensuring consistent, reliable compensation. About the Role We’re hiring Code...
-
Senior Code Reviewer for LLM Data Training
2 weeks ago
Toronto, Canada G2i Inc. Full timeAbout the Company G2i connects subject-matter experts, students, and professionals with flexible, remote AI training opportunities, including annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation. About the Role We’re...
-
Senior Code Reviewer for LLM Data Training
2 weeks ago
Toronto, Canada G2i Inc. Full timeAbout the Company G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation. About the Role We’re hiring a Code...
-
Fire Protection Mechanical Engineer
3 days ago
Toronto, Canada LRI Engineering - Fire Protection & Building Code Full timeA specialized engineering firm in Toronto is seeking an experienced Fire Protection Systems Engineer to manage projects and ensure compliance with relevant building codes. The ideal candidate has a university degree in Mechanical Engineering, a P. Eng. title, and a minimum of 5 years in fire protection systems engineering. Responsibilities include project...
