Senior Software Engineer, AI Infra
About The Position
The AI Infrastructure team builds and operates the foundation powering machine learning and AI across Robinhood, including infrastructure for feature engineering, training pipelines, model serving, inference, observability, and the company’s LLM gateway. The Senior Software Engineer will work across traditional ML infrastructure and emerging LLM technologies, helping improve GPU efficiency, scale model serving, and develop intelligent routing systems. This role offers meaningful ownership on a small, growing team and the opportunity to shape infrastructure supporting Robinhood’s next generation of AI capabilities. The position is based in Robinhood’s Menlo Park office, with in-person attendance expected at least three days per week. The engineer will collaborate with teams across Robinhood and own the operational health of critical infrastructure, including participating in an on-call rotation.
Requirements
- Strong software engineering experience focused on infrastructure, distributed systems, or large-scale backend platforms.
- Hands-on experience designing, building, and operating distributed systems in production, with a strong understanding of scalability, reliability, and system performance.
- Experience addressing complex infrastructure challenges, including latency optimization, resource utilization, and production system reliability.
- Strong software development and system design skills, including ownership of complex technical problems from design through production.
- Experience with infrastructure technologies and tools in production environments, and an understanding of building and operating reliable systems at scale.
- Ability to work independently, navigate ambiguity, and contribute to foundational engineering projects within a small, growing team.
- Interest in machine learning and AI infrastructure, and willingness to learn and work across traditional infrastructure and emerging AI technologies.
Nice To Haves
- Experience with ML infrastructure, model training or serving, GPU workload scheduling, LLM gateways, or open-source infrastructure technologies.
Responsibilities
- Design, build, and scale infrastructure powering machine learning and AI, including feature stores, training pipelines, model serving, inference, and observability.
- Build and optimize distributed systems for large-scale ML/AI workloads, focusing on performance, reliability, scalability, and latency.
- Develop scheduling solutions for training and inference workloads to improve GPU utilization and efficiency.
- Evolve Robinhood’s LLM gateway, including intelligent model routing, query and prompt understanding, and context optimization.
- Support reliable serving infrastructure for open-weight and fine-tuned models.
- Partner with engineering teams across Robinhood to understand infrastructure needs and build scalable, reusable solutions.
- Own the operational health of critical infrastructure through monitoring, troubleshooting, performance optimization, and participation in an on-call rotation.
Benefits
- Performance-driven compensation, bonus programs, equity ownership, and 401(k) matching.
- 100% paid health insurance for employees and 90% coverage for dependents.
- Access for eligible US employees to the Robinhood Employee Fund, providing exposure to Robinhood Ventures funds.
- Access to AI tools and continuous AI skill-building.
- Flexible lifestyle wallet for wellness, learning, and other spending.
- Employer-paid life and disability insurance.
- Fertility benefits and mental health benefits.
- Company holidays, paid time off, sick time, parental leave, and more.
- Catered meals, events, and comfortable workspaces.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
