Remote AI Automation Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Use backend engineering and complex systems integration to improve autonomous agents remotely as a freelance AI Automation Engineer on Outlier. Choose your schedule.
This contract opportunity supports training large language models for proactive, multi-step agent workflows. You will evaluate system behavior, investigate agent traces, and test live interactions across real-world environments. The work suits developers with at least two years of experience and practical automation expertise.
Key Responsibilities:
- Debug traces from multi-step autonomous agent workflows
- Write rubrics for evaluating agent performance
- Stress test agents against complex system behavior
- Review modular production-grade software implementations
- Assess persistent state and session discovery behavior
Requirements:
- Two or more years of relevant professional experience
- Experience building modular, production-grade software
- Practical experience with live, non-mocked systems
- Ability to deliver clear, high-density technical feedback
- Experience handling multi-turn system interactions
Bring AI automation, backend development, and systems integration skills to Outlier’s remote agent evaluation projects.
-
QA Automation Engineer with AI Integration
3 days ago
Calgary, AB, Canada Compunnel Inc. Full-time $70,000 - $90,000 ContractBoost software reliability as a QA Automation Engineer where you'll focus on automated test strategies and enhancing testing efficiency using AI tools. Collaborate within an Agile framework to validate software across platforms. This role involves executing and developing both automated and manual test cases, ensuring robust quality assurance practices. You...
-
AI Engineer Python Automation
5 days ago
Calgary, AB, Calgary Census Division, AB; Alberta, Canada Smart Circle International Full-timeBuild AI-powered solutions with Python and workflow automation for Smart Circle from a primarily remote position based in Richmond Hill, Ontario. Develop practical tools supporting analytics and customer success teams. As an AI Engineer, you will help design, build, and maintain AI-enabled workflows across Smart Circle. You will work with delivery, data,...
-
AI & Automation Process Engineer – Hybrid
5 days ago
Calgary, AB, Canada CIRO Full-time €93,000 - €113,000 ContractCIRO, Canada's self-regulatory organization for the investment industry, is seeking a Business Process Engineer, Innovation, to join the AI & Automation Centre of Excellence. This full-time role supports intake assessment, requirements clarity, and the successful delivery and adoption of AI and automation initiatives across CIRO. You will map current-state...
-
AI-Assisted Test Automation Engineer
17 hours ago
Calgary, AB, Canada 360training Full-time €90,000 - €120,000 ContractUse AI-assisted coding and testing tools at 360training to create reliable automation for applications, APIs, integrations, and business workflows. This QA Automation Engineer develops and maintains automated testing across the software development and deployment process. You will translate business requirements and manual test cases into maintainable...
-
Staff AI Automation Software Engineer
5 days ago
Calgary, AB, Canada Wagepoint Remote Full-time $120,000 - $160,000 ContractAdvance AI-driven development and automation at Wagepoint while leading reliable software delivery for its remote payroll application.As a senior technical leader, you will drive complex solutions, improve team efficiency, and support scalable application growth. The work combines full-stack engineering, cloud infrastructure, CI/CD pipelines, and emerging AI...
-
AI Automation Business Process Engineer
6 days ago
Calgary, AB, Canada CIRO / OCRI Full-time $93,000 - $113,000 ContractAI and automation process expertise drives this full-time Business Process Engineer role at CIRO, supporting workflow improvement and transformation delivery.Reporting to the Director of Innovation, you will support CIRO’s AI and Automation Centre of Excellence. You will assess opportunities, clarify requirements, map workflows, and address process and...
-
Senior QA Automation Engineer
4 days ago
Calgary, AB, Canada Upgrade, Inc. Remote Full-time $90,000 - $120,000 ContractUpgrade is seeking a Senior QA Automation Developer to own quality across new product initiatives. You will build automated and functional tests, work with product teams, and influence testing strategies from design through production in a fully remote Canada setup.You’ll use Java, Selenium and Playwright, deploy in Kubernetes environments, and collaborate...
-
QA Automation Engineer: AI-Driven Testing
3 days ago
Calgary, AB, Canada Compunnel, Inc. Full-time $70,000 - $90,000 ContractA leading technology service provider is seeking a QA Automation Engineer in Calgary, Alberta, responsible for ensuring high-quality software delivery through designing, executing, and maintaining effective test strategies and automation frameworks. The ideal candidate will have over 3 years of experience in QA, expertise in Java Selenium, API testing with...
-
QA Engineer: AI-Driven Test Automation
4 days ago
Calgary, AB, Canada TMC Canada Full-time $90,000 - $120,000 ContractA leading international technology consultancy seeks a Head of Talent Acquisition in Calgary, Alberta. This role focuses on defining quality strategies and providing mentorship in QA practices. Candidates should possess strong technical skills in testing methodologies, experience in CI/CD, and excellent communication abilities. The position offers a...