Senior Python Engineer | $150/hr Remote
4 days ago
Remote, Canada
Crossing Hurdles
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Position: Senior Software Engineer Python/TypeScript
Type: Contractor Assignment
Compensation: $150/hr
Location: Remote
Commitment: Part-time(20 hours/week), with at least 4 hours overlap during PST business hours
Role Responsibilities
- Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
- Design, refine, and iterate on rubrics and evaluation criteria for preference data.
- Review and label preference data while identifying subtle quality issues.
- Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
- Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.
Requirements
- Hands-on experience with preference data collection and/or rubric creation.
- Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
- Experience with AI/LLM evaluation or related engineering workflows is preferred.
- A LinkedIn profile is mandatory for review.
- Candidates should not currently be working with Microsoft.