Senior AI Operations Engineer
About The Position
The Corporate Engineering team builds and scales enterprise AI infrastructure at Robinhood, making AI capabilities reliable, secure, and accessible across the company. The team works on enterprise LLM integrations, agentic workflows, and hybrid cloud infrastructure to support internal AI use. The Senior AI Operations Engineer builds, operates, and improves the infrastructure behind Robinhood's enterprise AI capabilities. The role works across AI platforms, LLM integrations, automation, and production infrastructure; handles complex technical challenges; and partners with developers and internal teams. The position is based in Menlo Park, CA; New York, NY; or Bellevue, WA, and requires in-person attendance at least three days per week.
Requirements
- 5+ years of experience in IT Operations, Site Reliability Engineering, or AI infrastructure and support, with a track record of operating complex production systems.
- Hands-on experience with enterprise AI platforms and LLM integrations, particularly Anthropic Claude and Google Gemini, including API integrations, prompt operations, and token management.
- Strong Linux administration skills and proficiency in scripting and automation using Python, Bash, or similar languages.
- Experience with infrastructure provisioning, configuration management, and orchestration tools such as Terraform, Ansible, Chef, or Kubernetes.
- Strong understanding of production infrastructure, system reliability, monitoring, and troubleshooting across cloud or on-premises environments.
- Ability to independently investigate ambiguous technical problems, identify root causes, and develop scalable solutions that prevent recurring issues.
- Strong communication and collaboration skills, with experience partnering directly with developers and cross-functional teams to resolve technical challenges.
Nice To Haves
- Experience with GPU clusters, AI workload orchestration (Slurm, Ray), vector databases (Pinecone, Milvus), AI frameworks (LangChain, LlamaIndex), or hybrid cloud and bare-metal infrastructure.
Responsibilities
- Build internal tooling, automation, and self-service solutions to streamline AI operations, reduce manual intervention, and improve the developer experience.
- Own complex technical troubleshooting and escalations across AI platforms, resolving issues involving LLM integrations, model behavior, APIs, and system performance with developers and internal teams.
- Manage and optimize enterprise integrations with LLM providers, including Anthropic Claude and Google Gemini, with attention to performance, token utilization, reliability, and cost efficiency.
- Develop and improve observability, monitoring, and deployment pipelines for AI workloads, tracking inference latency, API costs, token usage, and error rates.
- Support and optimize agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation (RAG) systems to improve reliability and scalability.
- Partner with Product, Software Engineering, Business Systems, and AI Strategy teams to address recurring issues, incorporate user feedback, and drive long-term improvements to enterprise AI capabilities.
Benefits
- Performance-driven compensation with multipliers for outsized impact, bonus programs, equity ownership, and 401(k) matching.
- 100% paid health insurance for employees and 90% coverage for dependents.
- Eligible US employees may access the Robinhood Employee Fund, which provides exposure to Robinhood Ventures funds.
- Access to AI tools and continuous AI skill-building for employees.
- Lifestyle wallet, a flexible benefits spending account for wellness, learning, and more.
- Employer-paid life and disability insurance, fertility benefits, and mental health benefits.
- Company holidays, paid time off, sick time, parental leave, and more.
- Catered meals, events, and comfortable workspaces.
- Bonus opportunities and equity in addition to base pay.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
