Principal Software Engineer

Roblox•San Mateo, CA
•$295,250 - $345,040•Hybrid

About The Position

The Principal Software Engineer will join Roblox’s Observability team, which owns the telemetry, distributed tracing, and logging stack, including instrumentation libraries, data processing pipelines, data storage, and visualization UI. The team provides vital insight into the platform’s software components and focuses on delivering user-centered solutions for the teams it supports. The role will shape the team’s vision and roadmap with business partners and lead projects from inception through execution. A particular focus is developing novel ways to monitor AI/ML systems across the full AI/ML lifecycle and ecosystem. The engineer will take ownership of existing observability infrastructure, ensuring that it is scalable, reliable, and easy to use while extending it with new features. The role will also help architect the next-generation observability platform to ingest petabytes of log and tracing data each day. This is a hybrid role based at Roblox’s San Mateo headquarters. The position requires working in the office Tuesday through Thursday and reports to the Engineering Manager for Observability.

Requirements

  • At least 8 years of working experience.
  • Experience building, maintaining, and evolving large-scale distributed systems.
  • Demonstrated understanding of the components required to build modern, large-scale infrastructure.
  • Experience owning end-to-end availability and performance of critical services to reduce operational overhead.
  • A willingness to learn and adopt new technologies as the landscape evolves.
  • Passion for mentoring junior engineers and the ability to earn their respect and help them develop.
  • A BS in Computer Science or a related field.

Nice To Haves

  • Previous contributions to the open-source community.
  • A master’s degree or higher.

Responsibilities

  • Work with business partners to determine the vision and roadmap, and lead project execution end-to-end.
  • Develop novel solutions for monitoring AI/ML systems across the full AI/ML lifecycle and ecosystem.
  • Own existing observability infrastructure systems and ensure they are scalable, reliable, and easy to use.
  • Improve existing infrastructure with new features and functionality.
  • Architect the next-generation observability platform to ingest petabytes of log and tracing data each day.
  • Support the vision of putting the Roblox community first and getting things done.
  • Mentor junior engineers and help them grow their technical knowledge and build great software.

Benefits

  • Equity compensation for full-time employees.
  • Employee benefits as described on the company’s benefits page.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service