Senior Director, AI Interface Architecture

Credo•San Jose, CA

About The Position

We are seeking a Senior Director, AI Interface Architecture to solve the system-level interconnection challenges that connect XPUs (NPU/GPU/custom silicon) into working AI infrastructure. This role owns how compute elements are wired, networked, and orchestrated together at node, rack, and cluster scale so that large-scale LLM training and inference run efficiently across the platform.

Requirements

15+ years in systems/interconnect architecture or AI/HPC infrastructure, including 5+ years in a technical leadership role.
Solid understanding of NPU, GPU, and CPU architectures.
Strong grasp of DP, TP, PP, EP, and hybrid parallelism strategies and how they drive interconnect and communication patterns.
Familiarity with leading open LLM architectures (e.g., Kimi, Llama, DeepSeek, Mixtral, Qwen) and their impact on system-level communication.
Experience solving rack-, node-, and cluster-scale interconnection and workload-partitioning problems.
Understanding of LLM deployment methods across training and inference from a networking/system-integration perspective.
Strong cross-functional leadership and communication skills.
Bachelor's degree in Computer Engineering, EE, CS, or related field required.

Nice To Haves

Master's or PhD preferred.
Experience at a silicon vendor or hyperscaler solving system/network integration for accelerator hardware at scale.
Contributions to open-source AI infrastructure projects (Megatron-LM, DeepSpeed, vLLM, SGLang).
Experience with next-gen interconnect standards (UALink, UEC).

Responsibilities

Solve system-level interconnection challenges connecting XPUs (NPU/GPU/custom silicon) into working AI infrastructure.
Own how compute elements are wired, networked, and orchestrated together at node, rack, and cluster scale.
Ensure large-scale LLM training and inference run efficiently across the platform.