Engineering Manager, Compiler & Runtime

Normal Computing Corporation • Palo Alto, CA

1d • $200,000 - $400,000

About The Position

Normal Computing is hiring an Engineering Manager, Compiler & Runtime to build and lead the team responsible for software that makes the company’s memory-based hardware programmable. The team will develop a compiler that takes PyTorch models to the hardware, the runtime that executes them, and the kernels in between. The hardware runs memory-bound parts of large-model inference inside memory rather than moving weights to a processor. Because the chip is pre-silicon, software development initially targets simulators and FPGA prototypes.

This is a people-leadership role on a technical team. The manager will grow the team, plan its work against the hardware program, and partner with the senior compiler architect, who sets technical direction. The role also involves coordinating with hardware, serving, and simulation teams and maintaining software development continuity as hardware progresses from simulation to silicon.

Requirements

• Experience managing engineers who build compilers, runtimes, or kernels for accelerators or other non-standard hardware.
• A track record of hiring and mentoring strong systems engineers.
• Sufficient depth in compilers and runtimes to review designs and weigh technical trade-offs with senior engineers.
• Experience delivering software against a hardware schedule, from simulation through bring-up.
• Familiarity with state-of-the-art ML compiler stacks and LLM inference workloads.

Nice To Haves

• Experience taking an accelerator software stack from zero to production at a startup or new hardware initiative.
• Experience with in-memory compute, processing-in-memory, or analog hardware interfaces.
• Experience shipping an SDK or software product to external customers.

Responsibilities

• Grow the compiler and runtime team, establish the hiring bar, and support engineers’ growth and careers.
• Translate the Systems Software roadmap into plans, milestones, and staffing for compiler, runtime, and kernel work, and deliver against those plans.
• Partner with the compiler architect to ensure technical decisions are made, staffed, and completed; review designs and weigh trade-offs.
• Coordinate with the hardware team responsible for drivers and firmware, as well as serving and simulation teams that depend on the compiler and runtime.
• Keep the compiler and runtime working across simulators, FPGA prototypes, and silicon as the hardware matures.
• Establish testing, release, and review practices to make the software stack reliable enough to ship to customers.
• Deliver an end-to-end path for running LLMs on the hardware through PyTorch.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: No Education Listed