Senior Software Engineer

1 week ago


Canada LLM Full time

LLM.co delivers private, secure large language model (LLM) solutions tailored for enterprises operating in highly regulated industries such as law, healthcare, finance, and government. We build and deploy domain-specific AI tools that help our clients gain insight and efficiency while maintaining full control over their data and compliance requirements. Position Overview We are looking for a Senior Software Engineer with a strong background in backend systems, distributed infrastructure, and AI product integration. You’ll be at the core of building robust, scalable software systems that enable the secure deployment, customization, and orchestration of large language models for enterprise use. As a key engineering leader, you\'ll work closely with AI researchers, DevOps engineers, and product teams to bring cutting-edge LLM capabilities into real-world enterprise environments—on-prem, cloud, or hybrid. Key Responsibilities Architect, develop, and maintain high-performance backend systems for LLM deployments Design APIs, services, and tooling to support model fine-tuning, inference, and RAG (retrieval-augmented generation) pipelines Collaborate with AI and ML engineers to integrate models into scalable and secure enterprise software workflows Build modular, reusable components for BYOD (Bring Your Own Data) ingestion, vector indexing, and embedding pipelines Optimize systems for speed, security, scalability, and maintainability across varied deployment environments (cloud/on-prem) Contribute to CI/CD pipelines, system observability, and automated testing infrastructure Lead code reviews, mentor junior engineers, and contribute to architectural decisions Stay current with the latest advancements in LLM orchestration, security best practices, and distributed system design Required Qualifications Bachelor\'s or Master’s degree in Computer Science, Engineering, or a related field 5+ years of software engineering experience, with a focus on backend or systems engineering Strong proficiency in Python and at least one other language (Go, Rust, TypeScript, etc.) Experience building APIs (RESTful or GraphQL) and backend services Familiarity with containerization, orchestration, and cloud infrastructure (Docker, Kubernetes, AWS/GCP/Azure) Strong understanding of data structures, concurrency, and distributed systems Comfort working with AI/ML teams and integrating AI models into productized environments Experience with SQL and NoSQL databases, vector stores (e.g., Pinecone, Qdrant, Weaviate), and RAG frameworks Preferred Qualifications Experience integrating LLMs and NLP systems into production workflows Exposure to LangChain, LlamaIndex, HuggingFace Transformers, or similar tools Security-first mindset with experience in enterprise authentication, authorization, and compliance Background in DevOps, observability, or cloud automation Previous work in legaltech, healthtech, or fintech sectors What We Offer Competitive salary and stock options Remote-first flexibility with collaborative team culture Opportunity to work on frontier AI technologies for high-impact industries Access to GPU compute and state-of-the-art LLM infrastructure Influence over architectural and product decisions at an early stage Private AI On Your Terms Get in touch with our team and schedule your live demo today #J-18808-Ljbffr



  • , , Canada Beacon Software Full time

    Beacon Software is a permanent capital holding company which acquires and grows essential businesses. We are a profitable series B+ firm that combines great technologists, operators and M&A professionals to accelerate the scale of the ambition of the dozens of businesses we own and operate. We are supported by capital from tier-1 venture capital, crossover,...


  • , , Canada ECI Software Solutions Full time

    Location: Canada - Remote (EST/CST Business Hours) We are seeking a Senior Software Engineer who is ready to play a crucial role in designing, planning, and executing our product modernization plans, going from a monolithic desktop application to a SaaS‑based cloud‑native architecture leveraging microservices and hosted in AWS. A Senior Software Engineer...


  • , , Canada Jonas Software Full time

    Senior Software Engineer (Java / AWS) Join to apply for the Senior Software Engineer (Java / AWS) role at Jonas Software. About The Role We are seeking a Senior Software Engineer with strong experience in Java development and modern cloud‑native architectures. This role will focus on designing, building, and maintaining scalable APIs and backend services,...


  • , , Canada Beacon Software Full time

    Beacon Software is a permanent capital holding company which acquires and grows essential businesses. We are a profitable series B+ firm that combines great technologists, operators and M&A professionals to accelerate the scale of the ambition of the dozens of businesses we own and operate. We are supported by capital from tier-1 venture capital, crossover,...


  • Canada Beacon Software Full time

    Beacon Software is a permanent capital holding company which acquires and grows essential businesses. We are a profitable series B+ firm that combines great technologists, operators and M&A professionals to accelerate the scale of the ambition of the dozens of businesses we own and operate. We are supported by capital from tier-1 venture capital, crossover,...


  • , , Canada Aplos Software Full time

    About Aplos, Raisely and Keela: We’re excited to share that Aplos, Raisely, and Keela have come together to form one unified company with a shared mission: to help nonprofit organizations thrive. While we continue to offer the products you know and love, we now operate as one team, dedicated to making nonprofit work easier, more impactful, and more...


  • , , Canada Alpine Software Group Full time

    About Velora: We’re excited to share that Aplos, Raisely, and Keela have come together to form one unified company, Velora, with a shared mission: to help nonprofit organizations thrive. While we continue to offer the products you know and love, we now operate as one team, dedicated to making nonprofit work easier, more impactful, and more sustainable....


  • , , Canada ECI Software Solutions Full time

    A leading software solutions company is looking for a Senior Software Engineer to play a crucial role in transforming their product architecture from a standalone application to a cloud-native SaaS model. The role involves designing, planning, and implementing high-quality software components while mentoring the engineering team in best practices of...


  • , , Canada Tempo Software Full time

    About Tempo With over 30,000 customers, including a third of Fortune 500 companies, Tempo is trusted to help organizations make their workflows work better. We create integrated solutions for time management, resource planning, budget management, roadmapping, program management, reporting, and more. We build the tech that enables the modern team to deliver...


  • , , Canada Jonas Software Full time

    Senior Director of Engineering – Healthcare AI & Innovation Overview We are seeking a visionary Senior Director of Engineering to lead our R&D and software engineering teams as we build AI-enhanced healthcare solutions. This role requires a strategic, hands‑on engineering leader with deep experience in intelligent automation, and managing distributed...