Sr. Model Engineer, RL Training Framework

xAI • Palo Alto, CA

3d

About The Position

The RL infrastructure team is seeking an engineer to develop the reinforcement learning training framework. The role involves building systems that support RL workloads, from small-scale ablations to production training runs, and improving the performance, scalability, and observability of the RL stack.

Requirements

• Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++.
• Experience training large models, such as pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters.

Nice To Haves

• Experience building, debugging, and optimizing the efficiency of large-scale distributed systems.
• Experience with large-scale LLM training infrastructure.
• Experience with RL numerics.
• Strong knowledge of reinforcement learning techniques.
• Comfortable diving into unfamiliar areas and solving problems at all levels of the stack.

Responsibilities

• Design and implement systems supporting all RL workloads at SpaceXSI, from small-scale ablations to production training runs.
• Profile, debug, and optimize end-to-end training performance.
• Improve the scalability and observability of the RL stack.

Benefits

• Equity.
• Comprehensive medical coverage.
• Vision coverage.
• Dental coverage.
• Access to a 401(k) retirement plan.
• Short- and long-term disability insurance.
• Life insurance.
• Various other discounts and perks.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed