AI Architect

2 weeks ago


Ottawa, Ontario, Canada 49 Solutions Full time

49 Solutions is seeking an experienced AI Tester / Architect Consultant to join our client at IRCC for innovative projects within the Canadian Federal Government. You will play a critical role in ensuring the functionality, performance, and reliability of AI applications, combining technical expertise with a deep understanding of AI technologies to contribute effectively across multiple initiatives.

Requirements

What You'll Do:

  • Design, develop, and execute test strategies for AI applications, including AI agents, RAG, and LLMs. Create test plans and cases, conduct functional, performance, and integration testing, identify potential model biases and edge cases, and collaborate with developers and data scientists to improve AI reliability and accuracy.
  • Leverage AI tools to test applications on a regular basis, using prompts and outputs to generate and maintain test cases that evolve as AI models are updated or modified.
  • Evaluate and validate machine learning models, algorithms, and AI frameworks such as TensorFlow, Keras, and PyTorch to ensure optimal performance and accuracy.
  • Implement test automation for AI systems using Python, Java, or R to streamline testing processes and ensure repeatable results.
  • Collaborate with cross-functional teams to identify, analyze, and resolve performance or functionality issues, ensuring AI applications meet project requirements.
  • Support DevOps processes and CI/CD pipelines in AI application deployment, enabling seamless integration and continuous delivery.
  • Ensure compliance with best practices and security requirements for federal government projects, maintaining high standards of quality and reliability.

What We're Looking For:

  • Minimum 5 years of experience in software testing or test automation, specifically with AI applications.
  • Strong proficiency with AI frameworks, testing tools, and AI technologies.
  • Experience with AI agents, RAG, LLMs, and machine learning models.
  • Strong programming skills in Python, Java, or R.
  • Familiarity with DevOps processes and CI/CD pipelines.
  • Excellent analytical, problem-solving, and communication skills.
  • A degree in Computer Science, Engineering, or a related field.
  • A valid Canadian Government Security Clearance is a non-negotiable
Benefits

Remote/Hybrid Work


  • AI Architect

    2 weeks ago


    Ottawa, Ontario, Canada 49 Solutions Full time

    49 Solutions is seeking an experienced AI Tester / Architect Consultant to join our client at IRCC for innovative projects within the Canadian Federal Government. You will play a critical role in ensuring the functionality, performance, and reliability of AI applications, combining technical expertise with a deep understanding of AI technologies to...


  • Ottawa, Ontario, Canada Genesys Full time

    Genesys empowers organizations of all sizes to improve loyalty and business outcomes by creating the best experiences for their customers and employees. Through Genesys Cloud, the AI-powered Experience Orchestration platform, organizations can accelerate growth by delivering empathetic, personalized experiences at scale to drive customer loyalty, workforce...

  • Solutions Architect

    4 days ago


    Ottawa, Ontario, Canada Cohere Full time

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...


  • Ottawa, Ontario, Canada N-able Full time

    Why N-ableAt N-able, we're not just helping businesses be secure —we're redefining what it means to be cyber resilient. Our end-to-end platform blends AI-powered capabilities and flexible tech stacks, so customers can manage, secure, and recover with confidence. But the real power behind it all? Our people. We're a global crew of N-ablites, who love...

  • Solutions Architect

    4 days ago


    Ottawa, Ontario, Canada Cohere Full time

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...

  • Solutions Architect

    3 days ago


    Ottawa, Ontario, Canada Cohere Full time

    Who are we? Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI. We obsess over what we...


  • Ottawa, Ontario, Canada CDW Canada Full time

    DescriptionAt CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It's why we're coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who...


  • Ottawa, Ontario, Canada Assent Full time

    Company DescriptionAssent is the leading solution for supply chain sustainability tailored for the world's top-tier, sustainability-driven manufacturers. Hidden risks riddle supply chains, many of which weren't built with sustainability in mind. That's where we step in. With insights from experts, Assent is the tool manufacturers trust for comprehensive...


  • Ottawa, Ontario, Canada Assent Full time

    Company Description Assent is the leading solution for supply chain sustainability tailored for the world's top-tier, sustainability-driven manufacturers. Hidden risks riddle supply chains, many of which weren't built with sustainability in mind. That's where we step in. With insights from experts, Assent is the tool manufacturers trust for comprehensive...


  • Ottawa, Ontario, Canada Assent Full time

    Company Description Assent is the leading solution for supply chain sustainability tailored for the world's top-tier, sustainability-driven manufacturers. Hidden risks riddle supply chains, many of which weren't built with sustainability in mind. That's where we step in. With insights from experts, Assent is the tool manufacturers trust for comprehensive...