Agentic AI Architect

Altera Semiconductor•San Jose, CA

About The Position

We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA and ASIC platforms. The role sits at the intersection of large language models, agent frameworks and autonomous systems, retrieval-augmented generation, and hardware-aware AI system design. The architect will define system architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration. The role includes designing agentic AI systems and enterprise-scale RAG pipelines, developing LLM workflows and multi-agent orchestration, and optimizing AI systems for FPGA, ASIC, and heterogeneous computing platforms. It also involves building reusable AI platforms and components, collaborating with hardware teams on EDA and system integration, and providing technical leadership through architecture reviews, engineering guidance, mentorship, and cross-functional influence. This is a senior technical leadership opportunity focused on the convergence of AI reasoning systems, FPGA acceleration, and next-generation computing platforms. The work is intended to enable intelligent system orchestration, real-time decision-making pipelines, and scalable AI deployment on FPGA platforms. The listed Bay Area, California pay range is $149,100–$238,200 USD; actual salary may vary based on factors such as location, job-related knowledge, skills, experience, and training. Incentive opportunities based on individual and company performance are also offered. Applicants must be eligible for any required U.S. export authorizations. The company uses artificial intelligence to screen, assess, or select applicants.

Requirements

  • Master’s or bachelor’s degree with 10+ years of experience in one or more of AI/ML systems, distributed systems, or hardware–software co-design.
  • Recognized expertise in AI and large language models.
  • Deep understanding of LLM architectures and inference, RAG systems and vector databases, and agentic AI or autonomous agents.
  • Hands-on experience building production-grade LLM applications, multi-step reasoning and orchestration workflows, and scalable, reliable AI systems in production.
  • Strong background in FPGA, ASIC, or EDA systems and heterogeneous computing architectures.
  • Familiarity with hardware acceleration for AI workloads and performance optimization across the system stack.
  • Programming experience in Python; C++ is preferred.
  • Experience with distributed systems design, APIs and microservices architecture, and cloud and/or edge AI deployment.
  • Hands-on experience with LLM fine-tuning, quantization, and model distillation.
  • Hands-on experience with on-device or edge AI deployment.
  • Applicants must be eligible for any required U.S. export authorizations.

Nice To Haves

  • Experience in robotics, autonomous systems, or real-time AI pipelines.
  • Knowledge of compiler stacks such as MLIR or TVM.
  • Knowledge of AI model optimization for FPGA platforms.
  • C++ programming experience.

Responsibilities

  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration.
  • Architect RAG pipelines for enterprise-scale knowledge integration.
  • Define end-to-end AI system architecture spanning data ingestion, reasoning, and action.
  • Develop workflows for tool-using agents, planning and reasoning agents, and multi-agent collaboration.
  • Evaluate and integrate open-source and proprietary LLMs.
  • Optimize prompt engineering, memory, and reasoning capabilities.
  • Co-design AI systems with FPGA acceleration, ASIC platforms, and heterogeneous CPU/GPU/FPGA computing.
  • Explore LLM inference optimization on FPGA, including quantization, compilation, and partitioning.
  • Collaborate with hardware teams on EDA and system integration.
  • Build internal platforms using LangChain, LlamaIndex, or custom agent orchestration frameworks.
  • Develop reusable components for memory management, tool integration, and knowledge retrieval.
  • Lead architecture reviews and guide engineering teams.
  • Mentor senior engineers, influence cross-functional teams, and drive innovation in AI and hardware convergence.

Benefits

  • Incentive opportunities based on individual and company performance.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service