AI Architect

KLDiscovery•United States,

1d•$190,000 - $230,000•Remote

About The Position

KLDiscovery is seeking its most senior AI practitioner, an AI Architect, to own the strategic direction for generative AI and ML engineering. This role involves hands-on building and leadership, working with vast amounts of legal data (emails, contracts, chat transcripts, images, video, depositions, and regulatory filings) to develop AI solutions that can significantly accelerate legal matter resolution. The architect will design and implement agent workflows, retrieval systems, and evaluation frameworks, setting the technical direction for the company's eDiscovery platform, Nebula, and Customer Support & Operations. This is a builder-first role requiring active coding and development.

Requirements

7+ years in machine learning, applied AI, or ML engineering, with recent hands-on experience as a senior or principal-level builder in the gen AI era
Proven track record architecting and personally building enterprise gen AI systems in production with customer impact
Builder at heart: still writes code, ships, and tunes prompts and evals, and wants to keep doing so as a leader
Deep expertise across the modern gen AI stack: LLMs, agents, RAG, vector databases, embeddings, search, and evaluation harnesses
Hands-on experience designing system-of-systems AI pipelines spanning search, retrieval, agent harnesses, and model selection/triage
Strong proficiency with the Microsoft AI stack: Azure OpenAI, Azure AI Foundry, Azure AI Search, and supporting Azure infrastructure
Experience owning MLOps and AI telemetry: model deployment, eval pipelines, monitoring, drift detection, and prompt/agent observability
Excellent technical leadership skills; demonstrated ability to influence architecture decisions across product and engineering
Strong communication skills, including explaining AI architecture trade-offs to executive and customer audiences

Nice To Haves

Advanced degree (MS or PhD) in Computer Science, Machine Learning, Statistics, or related field
Background building agentic systems with tool use, planning, and multi-step reasoning in production
Prior experience setting up AI governance and evaluation harnesses
Open-source contributions, technical writing, conference talks, or other evidence of being a recognized builder in the AI community

Responsibilities

Own the AI-native architecture and build it, defining the end-to-end gen AI architecture across Nebula and CS & Operations, covering LLMs, agent harnesses, RAG, vector search, embeddings, and model selection and triage.
Build the hardest parts personally: prototype agent loops, tune retrieval, design evals, and ship the shared infrastructure that powers AI Case Explorer (case overviews, timelines, key people and themes, PII surfacing, and Agent chat), AI Agent Review (pre-classifying relevance, privilege, and key issues, shipping MLP), and CS & OPS tech-enablement using AI as a core part of our central work orchestration system.
Own AI/MLOps and AI telemetry end-to-end, including model deployment and versioning, eval pipelines, drift and quality monitoring, cost and latency telemetry, and prompt and agent observability.
Define and implement how we select, triage, and route across models (Azure OpenAI, Anthropic, open-source, fine-tuned), manage vector databases and retrieval, and evolve our agent harness as the frontier moves.
Lead the AI practice from the front by building, not just reviewing.
Partner with Engineering, Product, and Data Science leadership to translate architecture into delivery.
Raise the bar on AI engineering, mentor senior ICs through hands-on technical leadership, and represent KLD's AI strategy with customers, partners, and at industry events.