Remote Senior Software Engineer Evaluator
15 hours ago
canada ca
g2i
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Evaluate cutting-edge AI coding interactions with a remote Senior Software Engineer role. Analyze and judge AI models like OpenAI Codex for their engineering precision and responsiveness.
This position is ideal for a Senior, Staff, or Principal-level engineer. You will leverage your expertise in TypeScript, JavaScript, or Python to determine how well AI coding agents perform in real-world scenarios. Expect a focus on writing clear, opinionated feedback based on your evaluations.
Key Responsibilities
• Evaluate AI-generated coding interactions from start to finish
• Assess outputs for usefulness and engineering alignment
• Provide critical feedback on quality and reasoning
• Distinguish between different levels of response quality
• Define what exemplary AI interactions should look like
Requirements:
• Senior engineer with relevant experience in AI tools
• Proficient in TypeScript, JavaScript, or Python
• Familiarity with modern AI-assisted developer workflows
• Strong English communication skills (B2 or above)
• Comfort giving direct feedback based on evaluations Bring your engineering expertise and judgment to assess AI interactions effectively.
Key Responsibilities
• Evaluate AI-generated coding interactions from start to finish
• Assess outputs for usefulness and engineering alignment
• Provide critical feedback on quality and reasoning
• Distinguish between different levels of response quality
• Define what exemplary AI interactions should look like
Requirements:
• Senior engineer with relevant experience in AI tools
• Proficient in TypeScript, JavaScript, or Python
• Familiarity with modern AI-assisted developer workflows
• Strong English communication skills (B2 or above)
• Comfort giving direct feedback based on evaluations Bring your engineering expertise and judgment to assess AI interactions effectively.