Staff AI Engineer (Remote Eligible)

Capital One•San Jose, CA
•$244,700 - $335,100

About The Position

Capital One is hiring a Staff AI Engineer for its Intelligent Foundations and Experiences (IFX) team, which builds foundational AI capabilities and personalization experiences. The team is developing a core personalization service for agent-led experiences across varied product areas, with a focus on maintaining privacy, trust, and appropriate behavior for each use case. The role will architect a unified, low-latency personalization engine to model user intent, preferences, and constraints across product verticals. It will define how long-horizon user state is represented, governed, and used in real-time agent planning, balancing autonomy with deterministic safeguards in financial workflows. The engineer will contribute to the technical vision and roadmap for foundational AI systems and set enterprise-wide architecture direction, including shared tooling, observability, and deployment standards. The position involves designing, developing, testing, deploying, and supporting AI components and systems, including foundation-model training, LLM inference, agent and multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability. It also includes model optimization and ownership of model routing, caching, and orchestration for hybrid and multi-model workloads. The engineer will partner across engineering, research, program management, and product teams, promote responsible AI, and support internal education and mentorship. Capital One is open to remote or hybrid work for this opportunity. Compensation depends on work location. The listed full-time annual salary range is $244,700–$279,200 for remote work; ranges for listed office locations are $269,100–$307,200 in Cambridge, MA and McLean, VA, and $293,600–$335,100 in New York, NY, San Francisco, CA, and San Jose, CA. The position is also eligible for performance-based incentive compensation, which may include cash bonuses and/or long-term incentives. Capital One offers a comprehensive benefits program; eligibility varies by employment status and management level.

Requirements

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 8 years of experience developing AI and ML algorithms or technologies; or a master’s degree in one of these fields and at least 6 years of such experience.
  • At least 8 years of programming experience with Python, Go, Scala, CUDA, or Java.
  • Expertise in context management, recommendation systems, or identity infrastructure, with an interest in applying these concepts to agentic systems.
  • Extensive background building high-throughput systems, stateful memory architectures, or advanced RAG pipelines with strict data partitioning.
  • Strong ability to define unified APIs, align stakeholders on system boundaries, and design for graceful degradation and user trust.
  • Strong engineering and mathematics foundation, with technical expertise in hardware, software, and AI.
  • Ability to interpret scientific publications and judiciously apply research techniques in production.
  • Ability to handle ambiguous problems, investigate root causes, communicate findings clearly, and advance new ideas.
  • Ability to adapt and find paths to achieve business goals when the route is unknown.

Nice To Haves

  • Experience designing AI systems that balance cost, latency, throughput, and accuracy.
  • At least 8 years of experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
  • Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
  • Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level.
  • Experience developing AI and ML technologies such as LLM inference, similarity search and vector databases, guardrails, or memory using Python, C++, C#, Java, CUDA, or Golang.
  • Experience developing and applying state-of-the-art training and inference optimization techniques to improve hardware utilization, latency, throughput, and cost.
  • Experience building agentic AI systems and workflows.
  • Excellent communication and presentation skills, including the ability to explain complex AI concepts to peers.
  • Track record of defining and operationalizing enterprise AI architecture standards, including data pipeline governance, observability, and evaluation frameworks.
  • Experience leading federated or multi-cloud AI strategies to maximize resilience, compliance, and compute efficiency.
  • Success influencing research-to-production processes, including model handoff, evaluation, and productization.
  • Experience defining north-star metrics for AI systems that balance business value, innovation velocity, cost, and ethical responsibility.
  • Experience right-sizing models, instance counts, and hardware types based on requirements such as context length and input and output token volume.

Responsibilities

  • Architect a unified, low-latency personalization engine that models user intent, preferences, and constraints across different product verticals while protecting privacy.
  • Define how long-horizon user state is represented, governed, and incorporated into real-time agent planning.
  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
  • Design, develop, test, deploy, and support AI software components, including foundation-model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
  • Develop foundation-model optimization techniques that improve production-system scalability, cost, latency, and throughput.
  • Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
  • Set technical direction for enterprise-wide AI architecture, unifying tooling, observability, and deployment standards across teams.
  • Design and integrate model routing, caching, and orchestration systems for hybrid and multi-model workloads.
  • Embed responsible AI principles, including transparency, reproducibility, and fairness-by-design, in system design.
  • Drive internal education, mentorship, and sharing of best practices through architecture councils and AI guilds.

Benefits

  • Comprehensive health, financial, and other benefits supporting employee well-being; eligibility varies by employment status and management level.
  • Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service