AI Solutions Architect

Guidehouse • Huntsville, AL

1d

About The Position

Guidehouse is seeking an AI Solutions Architect / Technical Lead to join our Technology / AI and Data team, supporting mission-critical initiatives for Defense and Security clients. In this role, you will serve as the principal architect for advanced AI platforms, driving end-to-end design across ingestion, retrieval-augmented generation (RAG), large language model (LLM) inference, and secure, scalable workflows. You will provide technical leadership and architectural governance to ensure coherence, performance, and compliance with stringent federal standards, while collaborating with engineers, data specialists, and mission stakeholders to deliver innovative solutions that enable data-driven decision-making. This is an opportunity to shape cutting-edge AI capabilities that directly support national security objectives.

Requirements

• An ACTIVE and MAINTAINED "TOP SECRET" Federal or DoD security clearance.
• 8+ years of experience designing secure, scalable cloud architectures using container orchestration, distributed systems, workflow automation, microservices, and GPU-accelerated workloads.
• Deep expertise in AWS GovCloud, Kubernetes/EKS, GPU workloads, distributed systems, workflow orchestration, and microservice architecture.
• Proven experience architecting AI/ML or LLM-enabled platforms.
• Experience working within FedRAMP High, RMF or similar compliance frameworks.
• Ability to lead multi-disciplinary engineering teams and define end-to-end system architectures.

Nice To Haves

• An ACTIVE and MAINTAINED "TOP SECRET" Federal or DoD security clearance.
• Once onboard with Guidehouse, new hire MUST be able to OBTAIN and MAINTAIN a Federal or DoD "TOP SECRET/SCI (TS/SCI)" security clearance.
• AWS GovCloud services (EC2, S3, EKS, Lambda, KMS, API Gateway, etc.)
• Kubernetes/EKS specifically (vs. generic container orchestration).
• Step Functions / EventBridge / Bedrock.
• Vector DB experience (FAISS, pgvector, Milvus).
• LLM serving frameworks (vLLM, TGI, Sagemaker).
• Experience with SEAD‑4 adjudication, personnel vetting, continuous vetting, or investigative review workflows.
• Experience fine‑tuning open‑weight LLMs in secure or air‑gapped environments using LoRA/QLoRA or SFT.
• Experience with knowledge graphs, entity resolution pipelines, reasoning verification, or explainability frameworks.
• AWS Solutions Architect Professional, Security, or Machine Learning certifications.

Responsibilities

• Serves as the principal technical architect for the FBI adjudication AI platform, responsible for end-to-end architecture spanning ingestion, RAG, LLM inference, structured scoring, continuous learning loops, and analyst-facing mission workflows.
• Leads a dual-path LLM strategy that supports self-hosted open‑weight LLMs in AWS GovCloud as well as FedRAMP High managed model endpoints, ensuring secure, scalable, compliant, and mission‑aligned model operations.
• Provides architectural governance across backend services, model pipelines, data engineering, DevSecOps, and UI/UX components to ensure coherence, performance, and SEAD‑4 adjudication alignment.
• Ensures platform architecture conforms to FedRAMP High, RMF, NIST 800‑53, and FBI ATO requirements, including boundary definition, logging standards, and continuous monitoring readiness.
• Define the complete technical architecture for document ingestion, long‑document processing, embedding generation, vector search, anomaly detection, LLM inference, and adjudication memo generation components.
• Architect scalable infrastructure for 200M+ tokens/month processing volumes, supporting GPU‑based inference clusters, model routers, caching layers, and workflow orchestration services.
• Establish architectural standards for both self‑hosted GPU clusters and managed model endpoints, defining patterns for batching, KV‑cache utilization, parallel inference, and latency optimization.
• Produce architectural diagrams, sequence flows, integration contracts, and service interaction models to guide all development teams and maintain architectural consistency.
• Oversee design of AI/ML workflows supporting entity extraction, evidence linkage, SEAD‑4 scoring, anomaly detection, summarization, and document reasoning.
• Define fine‑tuning strategies using SFT, LoRA/QLoRA, dataset curation, evaluation pipelines, drift monitoring, and regression testing for consistent model quality.
• Establish standards for retrieval‑augmented generation (RAG), including embedding selection, retrieval indexing, chunking strategies, context assembly, and chain-of-thought management.
• Build monitoring patterns to detect hallucinations, scoring inconsistencies, bias, and model performance degradation across adjudicative domains.
• Ensure architecture supports FedRAMP High and RMF controls across data governance, encryption, access management, logging, segmentation, and monitoring.
• Author ATO documentation including SSPs, boundary diagrams, data flow diagrams, control implementation statements, and continuous monitoring artifacts.
• Embed secure‑by‑design engineering practices across APIs, data pipelines, LLM workflows, inference gateways, and audit logging layers.
• Define end‑to-end auditability standards capturing prompts, model outputs, retrieval contexts, scoring rationales, and analyst overrides.
• Provide senior engineering guidance to FBI leadership, translating complex model architecture, system behavior, and design tradeoffs into mission‑relevant insights.
• Guide sprint planning, backlog prioritization, code review practices, engineering QA, and decision analysis across AI/ML, backend, cloud, and security teams.
• Mentor senior engineers and ensure adherence to best practices for LLM integration, microservices development, and secure cloud operations.
• Collaborate directly with adjudicators, policy SMEs, mission stakeholders, and IT partners to ensure platform capabilities meet operational requirements.
• Identify and evaluate new technologies—including multimodal LLMs, knowledge graphs, retrieval fusion methods, and reasoning verification tools—to improve mission outcomes and analyst efficiency.
• Develop long‑term modernization strategies around learning loops, evidence provenance tracking, justification generation, and adaptive adjudication workflows.
• Support Guidehouse AI strategy, whitepapers, proposals, and federal AI modernization initiatives through technical leadership and domain expertise.

Benefits

• Medical, Rx, Dental & Vision Insurance
• Personal and Family Sick Time & Company Paid Holidays
• Position may be eligible for a discretionary variable incentive bonus
• Parental Leave and Adoption Assistance
• 401(k) Retirement Plan
• Basic Life & Supplemental Life
• Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
• Short-Term & Long-Term Disability
• Student Loan PayDown
• Tuition Reimbursement, Personal Development & Learning Opportunities
• Skills Development & Certifications
• Employee Referral Program
• Corporate Sponsored Events & Community Outreach
• Emergency Back-Up Childcare Program
• Mobility Stipend

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees