Observability Software Engineer - rednote

rednote • Palo Alto, CA

27d • $200,000 - $400,000

About The Position

We are seeking an Observability Software Engineer to join our team. This role involves end-to-end R&D of our observability platform, covering Metrics, Logging, Tracing, and Profiling. You will build full-stack observability infrastructure capabilities, drive technical architecture and product design for monitoring platforms, distributed tracing, log services, compute engines, alerting systems, and eBPF-based observability technologies. A key aspect of this role is ensuring high performance and availability of the observability infrastructure under high-concurrency conditions, and driving continuous iteration to support multi-region environments. Additionally, you will develop and implement AI Infra observability, AI application observability, and AI-powered observability capabilities to enhance stability and efficiency in AI scenarios.

Requirements

• Bachelor's degree or above in a relevant field.
• 3+ years of relevant work experience in computer science.
• Proficient in Java or Go.
• Solid foundation in concurrent programming, distributed systems, and performance optimization.
• Familiar with cloud-native observability products and components, including but not limited to: OpenTelemetry, CAT, SkyWalking, Prometheus, VictoriaMetrics, ELK, ClickHouse, eBPF.
• Working knowledge of Kubernetes and its fundamentals.
• Familiar with foundational open-source components such as Linux, networking, storage, and message queues.
• Deep understanding of implementation principles preferred.
• Strong problem-solving, communication, and cross-team collaboration skills.
• Eager to learn and stay current with industry trends.
• Fluent in both English and Chinese (spoken and written).

Nice To Haves

• Familiarity with AI-related technologies including but not limited to: PyTorch, Spring AI, Langfuse, LLM-based tooling.

Responsibilities

• Participate in the end-to-end R&D of the observability platform across all four pillars — Metrics, Logging, Tracing, and Profiling — building full-stack observability infrastructure capabilities.
• Drive the technical architecture and product design of monitoring platforms, distributed tracing, log services, compute engines (streaming analysis, real-time alerting, time-series anomaly detection, etc.), alerting systems, and eBPF-based observability technologies.
• Ensure high performance and high availability of observability infrastructure under high-concurrency conditions.
• Drive continuous technical and product iteration to support observability architecture design, data compliance, and infrastructure stability for the multi-region environments.
• Develop and implement AI Infra observability, AI application observability, and AI-powered observability capabilities to improve stability in AI scenarios and enhance the usability and efficiency of traditional observability products.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level