SDET AI Evaluation and Performance Testing
5 hours ago
Calgary, Canada
CrowdStrike Canada ULC
Full-time
€120,000 - €170,000/year
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.
As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike’s platform engineering team needs automation across functional, integration, and performance testing. You will also measure correctness, safety, latency, cost, tool use, and trajectory through eval-driven development.
Key Responsibilities
- Maintain golden datasets and AI agent scoring pipelines
- Enforce CI evaluation gates before releases
- Detect hallucinations, flaky tests, and judge bias
- Design realistic workloads for distributed services
- Review systems and agent designs for testability
Requirements:
- Computer Science degree or equivalent experience
- Five-plus years of software quality experience
- Python preferred for evaluation and agent work
- CI/CD test framework development experience
- Locust or k6 performance testing experience Bring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
Key Responsibilities
- Maintain golden datasets and AI agent scoring pipelines
- Enforce CI evaluation gates before releases
- Detect hallucinations, flaky tests, and judge bias
- Design realistic workloads for distributed services
- Review systems and agent designs for testability
Requirements:
- Computer Science degree or equivalent experience
- Five-plus years of software quality experience
- Python preferred for evaluation and agent work
- CI/CD test framework development experience
- Locust or k6 performance testing experience Bring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.