Agentic AI Architect

Altera•San Jose, CA
•$149,100 - $238,200•Onsite

About The Position

We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA and ASIC platforms. The role brings together large language models (LLMs), agent frameworks and autonomous systems, retrieval-augmented generation (RAG), and hardware-aware AI system design involving FPGA, ASIC, and EDA technologies. The architect will define system architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration. The position covers end-to-end AI architecture, agentic AI and LLM development, hardware-aware optimization, and internal platform development. It includes co-designing systems for FPGA acceleration, ASIC platforms, and heterogeneous CPU/GPU/FPGA computing; exploring FPGA-based LLM inference optimization; and collaborating with hardware teams on EDA and system integration. The role also provides technical leadership through architecture reviews, engineering guidance, mentoring, and cross-functional influence. This senior technical leadership role focuses on the convergence of AI reasoning systems, FPGA acceleration, and next-generation computing platforms. The work aims to enable intelligent system orchestration, real-time decision-making pipelines, and scalable AI deployment on FPGA platforms. The listed Bay Area, California salary range is $149.1K–$238.2K USD; actual salary may vary based on factors including location, job-related knowledge, skills, experience, and training. Incentive opportunities are also offered based on individual and company performance. Applicants must be eligible for any required U.S. export authorizations.

Requirements

  • Master’s or Bachelor’s degree with 10+ years of experience in one or more of AI/ML systems, distributed systems, or hardware–software co-design.
  • Recognized expertise in AI and large language models (LLMs).
  • Deep understanding of LLM architectures and inference, RAG systems and vector databases, and agentic AI/autonomous agents.
  • Hands-on experience building production-grade LLM applications, multi-step reasoning and orchestration workflows, and scalable, reliable AI systems in production.
  • Strong background in FPGA, ASIC, or EDA systems and heterogeneous computing architectures.
  • Familiarity with hardware acceleration for AI workloads and performance optimization across the system stack.
  • Programming experience with Python; C++ is preferred.
  • Experience with distributed systems design, APIs and microservices architecture, and cloud and/or edge AI deployment.
  • Hands-on experience with LLM fine-tuning, quantization, and model distillation; on-device or edge AI deployment; and robotics, autonomous systems, or real-time AI pipelines.
  • Knowledge of compiler stacks such as MLIR or TVM and AI model optimization for FPGA platforms.
  • Applicants must be eligible for any required U.S. export authorizations.

Nice To Haves

  • C++ programming experience is preferred.
  • Knowledge of compiler stacks such as MLIR or TVM.
  • Experience with LLM fine-tuning, quantization, and model distillation.
  • Experience with on-device or edge AI deployment.
  • Experience with robotics, autonomous systems, or real-time AI pipelines.

Responsibilities

  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration.
  • Architect RAG pipelines for enterprise-scale knowledge integration.
  • Define end-to-end AI system architecture from data ingestion through reasoning and action.
  • Develop workflows using tool-using agents, planning and reasoning agents, and multi-agent collaboration frameworks.
  • Evaluate and integrate leading open-source and proprietary LLMs.
  • Optimize prompt engineering, memory, and reasoning capabilities.
  • Co-design AI systems with FPGA acceleration, ASIC platforms, and heterogeneous CPU/GPU/FPGA computing.
  • Explore LLM inference optimization on FPGA, including quantization, compilation, and partitioning.
  • Collaborate with hardware teams on EDA and system integration.
  • Build internal platforms using LangChain, LlamaIndex, and custom agent orchestration frameworks.
  • Develop reusable components for memory management, tool integration, and knowledge retrieval.
  • Lead architecture reviews and guide engineering teams.
  • Mentor senior engineers and influence cross-functional teams.
  • Drive innovation in AI and hardware convergence.

Benefits

  • Incentive opportunities based on individual and company performance.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service