AI Engineer 3 (AI Foundations)

Capital One•San Jose, CA
•$161,800 - $201,400•Hybrid

About The Position

Capital One’s Intelligent Foundations and Experiences team builds proprietary AI models and platforms that enable teams across the company to deliver responsible, scalable AI products. The AI Engineer will work with engineers, research scientists, technical program managers, and product managers to develop AI-powered products for associates and customers. The role involves designing, developing, testing, deploying, and supporting foundational AI software, including model training and inference, agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability. The engineer will use open-source and SaaS AI technologies and develop optimization techniques to improve performance, scalability, cost, latency, and throughput of production systems. The position also contributes to the technical vision and long-term roadmap for Capital One’s foundational AI systems. The role is hybrid, subject to Capital One’s policy on required on-site presence at the designated office. It requires a relevant bachelor’s degree and at least three years of AI/ML development experience, or a relevant master’s degree and at least one year of such experience, plus at least three years of programming experience in a listed language.

Requirements

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 3 years of experience developing AI and ML algorithms or technologies; or a master’s degree in one of these fields plus at least 1 year of such experience.
  • At least 3 years of programming experience with Python, Go, Scala, CUDA, or Java.

Nice To Haves

  • Experience contributing to AI system components and making tradeoff decisions involving cost, latency, throughput, and accuracy.
  • 4 or more years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • Experience developing, delivering, and supporting AI services.
  • Experience developing AI and ML algorithms or technologies, such as LLM inference, similarity search, vector databases, guardrails, or memory, using Python, C++, C#, Java, CUDA, or Golang.
  • Experience developing and applying state-of-the-art training and inference optimization techniques to improve hardware utilization, latency, throughput, and cost.
  • Experience building agentic AI systems and workflows.
  • Demonstrated ability to evaluate and optimize LLM performance using quantitative metrics such as accuracy, coherence, latency, and cost.
  • Hands-on experience implementing retrieval-augmented generation, vector database integrations, and fine-tuning workflows.
  • Experience applying prompt-engineering strategies, safety guardrails, and red-teaming methodologies to production AI systems.

Responsibilities

  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agent and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Use open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
  • Develop foundation model optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
  • Contribute to the technical vision and long-term roadmap of foundational AI systems.
  • Lead development and benchmarking of multi-turn conversational and tool-using agent workflows, with measurable performance and safety metrics.
  • Implement scalable pipelines for training, fine-tuning, and deploying foundation or domain-specific models across multiple environments.
  • Collaborate with research and data engineering teams to curate datasets and improve model evaluation methodologies.
  • Contribute to model governance and security, including traceability, lineage documentation, and version control of deployed AI assets.
  • Mentor junior AI engineers and advocate for engineering excellence, reproducibility, and responsible experimentation.

Benefits

  • Comprehensive health, financial, and other benefits supporting total well-being.
  • Eligibility for performance-based incentive compensation, which may include cash bonuses and/or long-term incentives.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service