Founding Engineer, ML Systems & Performance

Engram Lab•San Francisco, CA

2d•Onsite

About The Position

Engram is developing AI that learns about users' specific contexts and histories, creating compact memories called 'engrams' to improve AI's ability to answer questions and process information efficiently. This approach aims to scale AI by enabling it to learn from user context. Engram is already collaborating with major AI companies like Microsoft, Notion, and Harvey, and has secured significant funding. The company's mission is for AI to learn about individual user worlds, not just general world knowledge.

Requirements

Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
5+ years of experience with training or inference systems, with a track record of optimizing workloads for measurable results.
Strong engineering foundation, with demonstrated excellence in navigating complex technical environments and shipping high-quality code in a fast-paced setting.
Deep understanding of ML frameworks (e.g., PyTorch, JAX), GPUs, distributed systems, and infrastructure.
Ability to operate effectively in ambiguous environments with a high degree of ownership.
A bias toward action and the ability to translate research concepts into concrete, executable plans.

Nice To Haves

Prior early-stage experience.
Experience in open-source ML or systems infrastructure projects.

Responsibilities

Designing and executing new frameworks, techniques, and systems to improve performance, reliability, latency, and efficiency of ML training and inference workloads.
Partnering closely with researchers to transform prototypes into scalable systems and providing feedback on system constraints to research decisions.
Optimizing serving paths for personalization and memory retrieval, focusing on per-user state and low latency.
Working on distributed training, including data and model parallelism, communication scheduling, and scaling efficiency across multiple GPUs and nodes.
Setting the engineering standard for Engram, including code review, testing, on-call responsibilities, and ensuring a strong security posture.
Helping to build the engineering team and influence the engineering culture as the company scales.