Senior AI Operations Engineer, Enterprise Tech

Robinhood • Bellevue, NY

6d • Hybrid

About The Position

Robinhood’s Corporate Engineering team is building and scaling enterprise AI infrastructure to make AI capabilities reliable, secure, and accessible across the company. The Senior AI Operations Engineer will build, operate, and improve the infrastructure behind enterprise AI capabilities, working across AI platforms, LLM integrations, automation, and production infrastructure. The role serves as a technical expert on complex challenges and partners directly with developers and internal teams to enable AI adoption across Robinhood.

The position is based in the Menlo Park, California; New York, New York; or Bellevue, Washington offices. In-person attendance is expected at least three days per week.

Requirements

• At least 5 years of experience in IT Operations, Site Reliability Engineering, or AI infrastructure and support, with a track record of operating complex production systems.
• Hands-on experience with enterprise AI platforms and LLM integrations, particularly Anthropic Claude and Google Gemini, including API integrations, prompt operations, and token management.
• Strong Linux administration skills and proficiency in scripting and automation using Python, Bash, or similar languages.
• Experience with infrastructure provisioning, configuration management, and orchestration tools such as Terraform, Ansible, Chef, or Kubernetes.
• Strong understanding of production infrastructure, system reliability, monitoring, and troubleshooting across cloud or on-premises environments.
• Ability to independently investigate ambiguous technical problems, identify root causes, and develop scalable solutions that prevent recurring issues.
• Strong communication and collaboration skills, with experience partnering directly with developers and cross-functional teams to resolve technical challenges.

Nice To Haves

• Experience with GPU clusters, AI workload orchestration tools such as Slurm or Ray, vector databases such as Pinecone or Milvus, AI frameworks such as LangChain or LlamaIndex, or hybrid cloud and bare-metal infrastructure.

Responsibilities

• Build internal tooling, automation, and self-service solutions to streamline AI operations, reduce manual intervention, and improve the developer experience.
• Own complex technical troubleshooting and escalations across AI platforms, working with developers and internal teams on issues involving LLM integrations, model behavior, APIs, and system performance.
• Manage and optimize enterprise integrations with LLM providers, including Anthropic Claude and Google Gemini, focusing on performance, token utilization, reliability, and cost efficiency.
• Develop and improve observability, monitoring, and deployment pipelines for AI workloads, tracking inference latency, API costs, token usage, and error rates.
• Support and optimize agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation systems to improve reliability and scalability.
• Partner with Product, Software Engineering, Business Systems, and AI Strategy teams to identify recurring issues, incorporate user feedback, and drive long-term improvements to enterprise AI capabilities.

Benefits

• Performance-driven compensation, bonus programs, equity ownership, and 401(k) matching.
• 100% paid health insurance for employees and 90% coverage for dependents.
• Access for eligible US employees to the Robinhood Employee Fund, providing exposure to Robinhood Ventures funds.
• Access to AI tools and continuous AI skill-building for all employees.
• Flexible lifestyle wallet for wellness, learning, and other spending.
• Employer-paid life and disability insurance, fertility benefits, and mental health benefits.
• Company holidays, paid time off, sick time, parental leave, and more.
• Catered meals, events, and comfortable workspaces.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed