Software Engineer, AI

Klue•Toronto, ON

9d•Hybrid

About The Position

At Klue, we are building the future of competitive intelligence. Klue Engineering is hiring a Software Engineer, AI to join their team in Toronto. This role focuses on building and optimizing state-of-the-art LLM-powered agents that can reason, plan, and automate workflows for users. This is an exciting opportunity for someone with strong Backend and ML fundamentals who wants to dive deep into practical LLM applications, as Klue is reinventing its insight generation systems. The successful candidate will lead the design and implementation of search and retrieval agent systems, enabling users to discover high-quality, relevant information with minimal effort. This position involves working at the intersection of LLM-powered agent workflows, retrieval pipelines, and evaluation frameworks, ensuring that systems remain scalable, efficient, and aligned with user intent. Klue is an AI-first company, leveraging AI agents to generate market, competitor, and buyer insights, automate tasks, and help organizations win more competitive deals. The company fosters a high-performance culture of curiosity, ownership, and collaboration, with a fast-growing, globally-distributed team.

Requirements

Software engineering experience
Experience with information retrieval systems, search relevance, and ranking models
Expertise in Python, with experience in frameworks such as PyTorch, TensorFlow, or JAX.
Familiarity with LLMs, prompt engineering, and retrieval-augmented generation pipelines.
Understanding of evaluation methods for search systems, including offline metrics and user-facing evaluation.
Experience working with vector database infrastructure (FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch)
Understanding of data pipelines, preprocessing, and large-scale data handling.
Ability to work independently and collaboratively in a fast-paced environment, balancing research and production needs.
Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models.
Knowledge of query understanding, document summarization and other content enrichment strategies
Expertise in automated LLM evaluation, including LLM-as-judge methodologies
Skilled at prompt engineering - including zero-shot, few-shot, and chain-of-thought.
Experience with cloud infrastructure (AWS, GCP, Azure) for scalable ML workflows.

Nice To Haves

Experience with agentic system design for LLM workflows.
Background in conversational search.
Contributions to open-source projects in the retrieval, NLP, or LLM ecosystems.

Responsibilities

Design and implement retrieval-augmented generation (RAG) systems with agentic workflows to refine query understanding, document retrieval, and response synthesis.
Build and optimize retrieval pipelines using BM25, dense retrieval, hybrid retrieval, and re-ranking approaches.
Develop evaluation pipelines for retrieval and generation, including offline metrics (recall, MRR, nDCG) and human-in-the-loop evaluations.
Experiment with query rewriting, expansion, and classification to improve retrieval relevance.
Collaborate closely with Product to bring ML-powered search agents into production.
Profile, debug, and optimize the latency, accuracy, and scalability of retrieval and generation components.
Contribute to the design of data pipelines for training retrieval and ranking models, including dataset curation, augmentation, and labeling workflows.
Stay up-to-date with advancements in LLMs, retrieval techniques, and agent architectures, evaluating opportunities to integrate them into our systems.

Benefits

High Performance Culture. We reward high performance and growth through career development, coaching, and annual performance reviews.
Comprehensive benefits: Extended health & dental coverage that starts on Day 1.
Fun perks like discounts at Goodlife and Perkopolis are gravy.
Ownership: All full-time employees have the opportunity to participate in our Employee Stock Option Plan.
Our Vacation Policy is Take The Time You Need. We just ask that you give notice and don’t leave your team hanging.
Top-tier tools. All employees will receive a Mac (or PC, if that’s your jam) and access to A+ tooling.
AI First. All employees are encouraged to lean into AI to work smarter and faster.
Growth / Leadership. Direct access to our leadership team, including our CEO, and opportunities to connect with incredible people across the company.
Social connection. There’s no shortage of ways to stay connected and have fun. We get together once a year in Vancouver for a company-wide kickoff. Throughout the year our Hubs hold regular social events.
Dog-friendly spaces. Bring your four-legged friend along in Vancouver or Toronto, as our offices are pup-approved.