Senior Software Engineer, Observability
About The Position
Robinhood is hiring a Senior Software Engineer for its Observability team, which builds and operates the full-stack observability platform supporting the reliability of Robinhood's products and services. The platform spans metrics, logs, distributed tracing, and alerting, and works with the Robinhood Command Center to meet or exceed a 99.9% uptime target. The engineer will serve as technical lead for the observability roadmap and own the observability control plane end-to-end. The role includes making architectural decisions, leading a team of six engineers, developing cost-efficient telemetry ingestion strategies, building in-house solutions where existing tools are insufficient, and integrating AI-driven approaches to advance full-stack observability. The position is based in the Menlo Park, California office and requires in-person attendance at least three days per week.
Requirements
- At least 5 years of software engineering experience.
- Proven track record of owning and delivering large-scale observability or infrastructure platform initiatives.
- Deep expertise in Kubernetes and public cloud environments; AWS is preferred.
- Ability to architect and operate distributed systems at scale, independently of specific vendor tooling.
- Strong coding proficiency in one or more languages such as Go or Python, with experience integrating observability agents, libraries, and instrumentation into production codebases.
- Experience owning an observability control plane or telemetry pipeline in a high-traffic production environment, including ingestion cost management, cardinality control, and signal routing.
Nice To Haves
- Experience with the Vector data pipeline or equivalent high-throughput log and metrics routing tools.
- Familiarity with Prometheus, Grafana, Honeycomb, Humio, or Sentry.
Responsibilities
- Define and execute the full-stack observability roadmap for metrics, logs, traces, and alerting infrastructure across Robinhood's engineering organization.
- Own and evolve the observability control plane, including telemetry ingestion pipelines, cost management strategies, and tools that keep observability components highly available.
- Lead and collaborate with a team of six engineers to build scalable, self-service observability solutions for product and infrastructure teams.
- Establish and maintain SLOs for observability systems that meet or exceed the 99.9% uptime target.
- Partner with the Robinhood Command Center and engineering teams on dependency mapping, incident response workflows, and observability standards.
- Make architectural decisions for the observability platform and build in-house solutions where off-the-shelf tooling falls short.
- Drive cost-efficient telemetry ingestion and integrate AI-driven approaches to advance full-stack observability.
Benefits
- Performance-driven compensation with multipliers for outsized impact, bonus programs, and equity ownership.
- 401(k) matching.
- 100% paid health insurance for employees and 90% coverage for dependents.
- Access to AI tools and continuous AI skill-building.
- Flexible lifestyle wallet benefits spending account for wellness, learning, and more.
- Employer-paid life and disability insurance.
- Fertility benefits.
- Mental health benefits.
- Company holidays, paid time off, sick time, and parental leave.
- Catered meals, events, and comfortable workspaces.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
