Sr. Model Engineer, RL Training Framework
SpaceXSI•Palo Alto, CA
•$180,000 - $400,000
About The Position
SpaceXSI is seeking an engineer for its RL infrastructure team to help develop the RL training framework. The role involves building the systems that support reinforcement learning workloads across scales, from small-scale ablations to production training runs, and improving the performance, scalability, and observability of the RL stack.
Requirements
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++.
- Experience training large models, such as pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters.
Nice To Haves
- Experience building, debugging, and optimizing the efficiency of large-scale distributed systems.
- Experience with large-scale LLM training infrastructure.
- Experience with RL numerics.
- Strong knowledge of reinforcement learning techniques.
- Comfortable diving into unfamiliar areas and solving problems at all levels of the stack.
Responsibilities
- Design and implement systems backing all RL workloads at SpaceXSI, from small-scale ablations to production training runs.
- Profile, debug, and optimize end-to-end training performance.
- Improve the scalability and observability of the RL stack.
Benefits
- Equity.
- Comprehensive medical coverage.
- Vision coverage.
- Dental coverage.
- Access to a 401(k) retirement plan.
- Short- and long-term disability insurance.
- Life insurance.
- Various other discounts and perks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
