Engineering Manager, Compiler & Runtime

Normal Computing Corporation • Palo Alto, CA

1d

About The Position

Normal Computing is an applied AI company building foundational hardware and software for the semiconductor industry, AI infrastructure, and broader systems. The company operates across New York City, Silicon Valley (Mountain View), London, Copenhagen, and Seoul.

Normal’s hardware performs memory-bound large-model inference inside memory. The Engineering Manager, Compiler & Runtime will build and lead the team developing the software stack that makes this hardware programmable: a compiler that translates PyTorch models to the hardware, the runtime that executes them, and the kernels between them. This is a people-leadership position on a technical team. The manager will hire and develop the team, plan its work against the hardware program, and partner with the senior compiler architect, who sets technical direction.

Because the chip is pre-silicon, the team initially develops against simulators and FPGA prototypes. The manager will coordinate with hardware, serving, and simulation teams and maintain software continuity as the hardware matures from simulation to silicon. Success includes enabling end-to-end LLM execution on the hardware through PyTorch and establishing reliable engineering practices for customer-ready software.

Requirements

• Experience managing engineers building compilers, runtimes, or kernels for accelerators or other non-standard hardware.
• Track record of hiring and mentoring strong systems engineers.
• Sufficient depth in compilers and runtimes to review designs and weigh technical trade-offs with senior engineers.
• Experience delivering software against a hardware schedule, from simulation through bring-up.
• Familiarity with state-of-the-art ML compiler stacks and LLM inference workloads.

Nice To Haves

• Experience taking an accelerator software stack from zero to production at a startup or new hardware initiative.
• Experience with in-memory compute, processing-in-memory, or analog hardware interfaces.
• Experience shipping an SDK or software product to external customers.

Responsibilities

• Build the compiler and runtime team, set the hiring bar, and support engineers’ growth and career development.
• Translate the Systems Software roadmap into plans, milestones, and staffing for compiler, runtime, and kernel work, and deliver against those plans.
• Partner with the senior compiler architect to ensure technical decisions are made, staffed, and completed; review designs and weigh trade-offs.
• Coordinate with the hardware team, which owns drivers and firmware, and with serving and simulation teams that depend on the compiler and runtime.
• Keep the compiler and runtime working across simulators, FPGA prototypes, and silicon as the hardware matures, so software development does not wait on tapeout.
• Establish testing, release, and review practices to make the software stack reliable enough to ship to customers.
• Deliver end-to-end LLM execution on the company’s hardware through PyTorch.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: No Education Listed