Engineering Manager, GenAI – Modeling

Modular•Los Altos, CA

2d•$234,000 - $286,000•Hybrid

About The Position

At Modular, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges. If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value. About the role: The GenAI Models team is building Modular’s cutting-edge models library on the MAX inference framework. Modular is re-imagining the AI software stack from the ground up, which requires deep collaboration and co-development across the company. We are looking for an Engineering Manager to lead an established, tight-knit group of passionate model engineers. Your mandate is to maintain this high-performance culture while scaling the team to support all modern model architectures. You will partner with Product to identify the latest industry trends, ensuring we deliver launch-day support for hot new models and drive the growth of our open-source community. LOCATION: Candidates based in the US or Canada are welcome to apply. You can work in our office in Los Altos, CA or remotely from home. Onboarding for new hires is conducted in-person in our Los Altos, CA office.

Requirements

3+ years of management experience with a proven track record of building high-performing collaborative teams of 5+ engineers.
4+ years of technical experience as a technical lead / contributor in the field of AI and software engineering.
In-depth understanding of deep learning, especially LLMs.
Adept at navigating ambiguity and ability to exercise sound judgment to identify appropriate solutions and tools, while avoiding unnecessary complexity.
Proficiency in Pythons, plus familiarity with frameworks such as MAX, Pytorch, or vLLM.

Responsibilities

Lead the scoping and development of new GenAI architectures for integration into the MAX stack, ensuring top accuracy from initial research to deployment.
Oversee the team maintaining the MAX library of state-of-the-art models.
Partner with the Modular product team to select and prioritize new architectures.
Scale and mentor the modeling team to the scale demanded by current market needs.
Drive process and technological advancements to enhance model development efficiency, and establish metrics to continuously measure and track improvements.
Champion the optimal model development experience by collaborating with stakeholders to influence the development of necessary libraries and tooling.
Collaborate with the Modular community to facilitate contributions to the models library.
Shape the Modular practices for collaboration and cross-stack development.

Benefits

Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders.
World-class Benefits. In order to attract the best, we need to offer the best. Premier insurance plans, up to 5% 401k matching, flexible paid time off, and more are available to you! Please note that specific benefit packages may vary based on your location.
Competitive Compensation. We offer very strong compensation packages, including stock options. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce.
Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume