Software Engineer - Supercomputing Platform & Infrastructure
About The Position
As a Software Engineer on our Supercomputing Platform & Infrastructure team, you will design and build resilient and optimized solutions for AI workloads on massive Computing Clusters. What you might work on: Work closely with the training and inference teams to deliver high performance and reliability across storage, networking, and distributed computing designs. Build the software stack to run massive-scale (thousands of GPUs), highly available supercomputing infrastructure Troubleshoot and resolve complex issues across hardware accelerated devices, networking, storage subsystems (local NVMe/Block Storage/NFS), OS, drivers and cloud environments, and automate detection and recovery processes Operate data-intensive workloads at petabyte-scale Increase the ease-of-use and self-serviceability of the compute platforms at Magic through top-notch documentation and developer workflow design Investigate and resolve incidents across security and availability
Requirements
- Experience working with production GPU deployments, data-intensive applications, large-scale model training and HPC
- Strong understanding of networking-, storage- and data-related technologies
- Experience with GCP, AWS, Azure, OCI or similar cloud platforms
- Strong software engineering skills
- Strong IaC knowledge with extensive experience in Terraform, Pulumi, AWS CDK/CloudFormation or similar
Responsibilities
- Work closely with the training and inference teams to deliver high performance and reliability across storage, networking, and distributed computing designs.
- Build the software stack to run massive-scale (thousands of GPUs), highly available supercomputing infrastructure
- Troubleshoot and resolve complex issues across hardware accelerated devices, networking, storage subsystems (local NVMe/Block Storage/NFS), OS, drivers and cloud environments, and automate detection and recovery processes
- Operate data-intensive workloads at petabyte-scale
- Increase the ease-of-use and self-serviceability of the compute platforms at Magic through top-notch documentation and developer workflow design
- Investigate and resolve incidents across security and availability
Benefits
- Annual salary range: $225K - $550K
- Equity is a significant part of total compensation, in addition to salary
- 401(k) plan with 6% salary matching
- Generous health, dental and vision insurance for you and your dependents
- Unlimited paid time off
- Visa sponsorship and relocation stipend to bring you to SF, if possible
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
11-50 employees
