Hardware Design Engineer, AI Inference Engine

ElastixAI•Seattle, WA

22h•Hybrid

About The Position

We are seeking a visionary and hands-on Hardware Design Engineer to contribute to the design, definition, and implementation of our core AI inference engine. This is a deeply technical role where you will be instrumental in translating AI into a highly efficient hardware design. You will be at the center of our co-design philosophy, working to ensure our inference engine is perfectly harmonized with our ML strategies, software stack, and cloud hardware targets to deliver unparalleled performance and efficiency for next-generation AI models.

Requirements

BS, MS or PhD in Computer Engineering, Electrical Engineering, or a related field.
Proven experience (5+ years) in hardware design, with a strong focus on designing/implementing hardware for AI/ML acceleration.
Deep understanding of modern AI/ML models, particularly LLMs, and their computational characteristics.
Experience with hardware implementation of ML optimization techniques (e.g., sparsity, quantization, pruning).
Proficiency in Verilog or SystemVerilog for RTL design and simulation.
Strong understanding of memory system architecture, on-chip interconnects, parallel processing, and distributed computing.
Excellent problem-solving skills and the ability to analyze complex systems.
Exceptional communication and interpersonal skills, with a demonstrated ability to work effectively in a highly interdisciplinary environment, collaborating with ML, software, and cloud/systems engineers.
Ability to thrive in a fast-paced, dynamic startup environment with a strong bias for action/execution.

Nice To Haves

Knowledge of compiler technologies for AI models (e.g., MLIR, TVM).
Familiarity with performance modeling and analysis tools.
Experience with system-level integration and debugging.
Contributions to relevant research publications or open-source projects.
Understanding of cloud computing environments and deploying hardware accelerators in the cloud.
High-speed inter-chip networking experience.

Responsibilities

Contribute to the architectural definition, design, and implementation of a novel AI inference engine optimized for our specific ML workloads.
Collaborate closely with ML engineers to understand and influence ML directions.
Work hand-in-hand with software engineers to define a seamless hardware-software interface, ensuring the inference engine is highly programmable, efficient, and easy to integrate into our broader software stack and compiler.
Partner with cloud engineers to ensure the inference engine architecture aligns with target cloud hardware capabilities, deployment strategies, and performance/cost objectives.
Model and analyze the performance, power, and area (PPA) trade-offs of different architectural choices.
Stay at the forefront of AI accelerator research, identifying emerging techniques and technologies relevant to our co-design approach.
Contribute to the RTL design, simulation, and verification efforts for the inference engine components.
Drive the hardware roadmap for the inference engine, anticipating future AI model trends and optimization opportunities.
Foster a culture of innovation and technical excellence within a highly interdisciplinary engineering team.