Software Engineering Manager - Meta Superintelligence Labs - Infra: Optimizations Team

Meta Platforms, Inc. • Menlo Park, CA

34d

About The Position

Meta is seeking hands-on engineering managers to join the Meta SuperIntelligence Lab (MSL), making direct contributions to the next generation of Generative AI models. The MSL Infra Optimizations team's mission is to enable the development and productionization of cutting-edge high-performance optimizers, kernels and numeric algorithms, providing comprehensive analyses of their effect for MSL. Join us and be a part of the team that is shaping the future of Meta SuperIntelligence Lab's infrastructure! About Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics. Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here. Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.

Requirements

• MS or BS in Computer Science or Electrical/Electronics Engineering or equivalent
• 3+ years of experience of directly managing or leading a team of engineers with varied skill levels
• Experience in leading teams working on high performance computing (HPC) and AI/ML systems, including:
• GPU/ASIC-based kernel development and optimization (e.g. CUDA)
• Distributed systems for large scale training and serving
• Systems Architecture + Performance
• Large scale distributed systems
• Experience running a large-scale program and dealing with ambiguity

Nice To Haves

• Familiarity with the latest techniques in optimizing GenAI workloads
• Using frameworks like PyTorch, TorchTriton to develop custom kernels
• Understands Kernel enablement and optimizations, including experience working on attention kernels
• Understanding GPU memory hierarchy and computation capabilities
• Understands low-level CUDA kernel optimizations for inference and training
• Experience with Quantization and structure sparsity for low precision training & inference
• Understands Optimizers such as Adam, Shampoo, Muon

Responsibilities

• Lead and support the team that develops various kernels including but not limited to GEMMs, Attention mechanisms etc. Also, contribute to enabling performance at scale of our inference and training of next generation GenAI (Llama) models
• Enable the growth of individual contributors, driving the technical roadmap along with technical leads and expand the impact of the team by growing new skill-sets and capabilities
• Lead a high performance team of engineers to deliver new capabilities and efficient compute systems for our fleet
• Technical management
• Experience in systems architecture, performance, workload-analysis and large scale distributed systems
• Work cross-functionally across hardware and software/services team to drive engineering efforts

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Industry: Broadcasting and Content Providers
• Number of Employees: 5,001-10,000 employees