AI Engineer 3 (AI Foundations)

Capital One•McLean, NY
•Hybrid

About The Position

Capital One’s Intelligent Foundations and Experiences team builds and deploys proprietary AI solutions and platforms used across the company to support responsible, scalable AI-powered products. The AI Engineer will work with engineers, research scientists, technical program managers, and product managers to develop systems that improve how associates work and how customers interact with Capital One. The role involves designing, developing, testing, deploying, and supporting AI software components, including foundation-model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability. The engineer will use open-source and SaaS AI technologies and develop optimization techniques for the scalability, cost, latency, and throughput of production AI systems. The position also contributes to the technical vision and long-term roadmap for foundational AI systems. Additional work includes developing and benchmarking conversational and tool-using agents; building pipelines to train, fine-tune, and deploy models across environments; collaborating on datasets and model evaluation; supporting model governance, security, traceability, lineage, and version control; and mentoring junior engineers. This is a hybrid role subject to Capital One’s on-site presence policy for the designated office location.

Requirements

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 3 years of experience developing AI and ML algorithms or technologies; or a master’s degree in one of those fields and at least 1 year of that experience.
  • At least 3 years of programming experience with Python, Go, Scala, CUDA, or Java.

Nice To Haves

  • Experience contributing to AI system components and making tradeoff decisions involving cost, latency, throughput, and accuracy.
  • 4+ years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • Experience developing, delivering, and supporting AI services.
  • Experience developing AI and ML algorithms or technologies, such as LLM inference, similarity search, vector databases, guardrails, or memory, using Python, C++, C#, Java, CUDA, or Golang.
  • Experience developing and applying state-of-the-art training and inference optimization techniques to improve hardware utilization, latency, throughput, and cost.
  • Experience building agentic AI systems and workflows.
  • Demonstrated ability to evaluate and optimize LLM performance using quantitative metrics such as accuracy, coherence, latency, and cost.
  • Hands-on experience implementing retrieval-augmented generation (RAG), vector database integrations, and fine-tuning workflows.
  • Experience applying prompt-engineering strategies, safety guardrails, and red-teaming methodologies to production AI systems.

Responsibilities

  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • Design, develop, test, deploy, and support AI software components, including foundation-model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Use open-source and SaaS AI technologies, such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
  • Develop foundation-model optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
  • Lead development and benchmarking of multi-turn conversational and tool-using agent workflows, with measurable performance and safety metrics.
  • Implement scalable pipelines for training, fine-tuning, and deploying foundation or domain-specific models across multiple environments.
  • Collaborate with research and data engineering teams to curate datasets and improve model evaluation methodologies.
  • Contribute to governance and security efforts, including model traceability, lineage documentation, and version control of deployed AI assets.
  • Mentor junior AI engineers and advocate for engineering excellence, reproducibility, and responsible experimentation.

Benefits

  • Comprehensive health, financial, and other benefits supporting total well-being.
  • Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service