AI Performance Optimization Engineer

Lightning AI • New York, NY

140d • Hybrid

About The Position

We are looking for a research engineer to work directly on the Lightning Thunder compiler and the rest of the PyTorch Lightning stack. This is an opportunity to create groundbreaking technology that will transform the machine learning ecosystem.

Requirements

• Strong experience with deep learning frameworks like PyTorch, JAX, or TensorFlow.
• Expertise in compiler development or optimizations in distributed training and inference workflows is highly valued.
• Proven track record contributing to open-source projects, especially in machine learning or high-performance computing. Experience collaborating with external partners is a plus.
• Hands-on experience in model optimization, with a focus on maximizing performance, efficiency, and scalability in large-scale or distributed training setups.
• Passion for engaging with open-source communities, including experience supporting users and advocating for project adoption.
• Strong communication and collaboration skills for working within a close-knit, high-impact team environment.
• Bachelor's degree in Computer Science, Engineering, or related field. Preferred Master's or PhD in machine learning and related areas.

Responsibilities

• Develop the Thunder compiler, an open-source project developed in collaboration with one of our strategic partners, using your deep experience in PyTorch, JAX, or other deep learning frameworks
• Engage in performance-oriented model optimizations, around distributed training as well as inference
• Develop optimized kernels in CUDA or Triton to target specific use-cases
• Integrate Thunder throughout the PyTorch Lightning ecosystem
• Engage with the community and champion its growth
• Support the adoption of Thunder across the industry
• Work closely within the Lightning team as a strategic partner

Benefits

• Competitive base salaries and stock options with a 25% one year cliff and monthly vesting thereafter.
• Medical, dental and vision
• Life and AD&D insurance
• Flexible paid time off plus 1 week of winter closure
• Generous paid family leave benefits
• $500 monthly meal reimbursement, including groceries & food delivery services
• $1,000 home office stipend
• $1,000 annual learning & development stipend
• 100% Citibike membership (NYC only)
• $45/month gym membership
• Additional various medical and mental health services

What This Job Offers

• Career Level: Mid Level
• Industry: Professional, Scientific, and Technical Services
• Education Level: Bachelor's degree
• Number of Employees: 11-50 employees