Principal Engineer - Observability

Core Weave • Sunnyvale, CA

76d • $206,000 - $303,000 • Hybrid

About The Position

We are seeking a highly experienced and strategic Principal Engineer to lead the architecture, development, and operations of our Observability product. In this role, you will help shape the vision and direction on how customers monitor, troubleshoot and run their AI workloads effectively, at scale. You will have direct access to customers and work closely with engineering stakeholders across multiple teams to advance the development of our unified Observability experience across CoreWeave products.

Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• 10+ years of experience in distributed systems, with a focus on reliability and scale.
• Proven experience leading storage product engineering projects and building products to address customer needs.
• Proficiency in one or more programming languages (e.g. Go, C, Rust).
• Good understanding of distributed observability systems such as ClickHouse for telemetry at scale.
• Strong understanding of cloud computing infrastructure using Kubernetes, scalable architectures, and automation.
• Excellent analytical and problem-solving skills, with the ability to synthesize problem statements from interactions with customers and design solutions given ambiguous requirements.
• Strong communication and interpersonal skills, able to convey storage engineering strategies and practices to technical and non-technical audiences.

Nice To Haves

• Prior experience with building Observability solutions is a plus.

Responsibilities

• Lead the strategy and implementation for Observability, ensuring alignment with business goals and performance objectives.
• Design and implement advanced solutions, including low-latency, high-scale Observability pipelines across all products.
• Build solutions that offer insights to customers for rapid troubleshooting of their AI workloads.
• Champion initiatives to improve the reliability, durability, and self-healing capabilities of Observability metrics, and assume operational responsibilities.
• Help shape customer experience by promoting unparalleled visibility into our systems' performance and reliability with customer facing metrics and dashboards.
• Analyze telemetry for production systems to identify opportunities for improvement in performance and reliability.
• Develop operational review practices for storage engineering to assess performance against targets and iterating on those targets.
• Act as a trusted advisor to senior leadership, providing insights on storage industry trends and advocating for investments in storage technologies.
• Collaborate with engineering, infrastructure, and product teams to ensure storage solutions align with evolving project requirements and technical architecture.
• Mentor and guide engineering teams on best practices in product engineering, fostering a customer-focused approach to systems design and technical excellence.

Benefits

• Medical, dental, and vision insurance - 100% paid for by CoreWeave
• Company-paid Life Insurance
• Voluntary supplemental life insurance
• Short and long-term disability insurance
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement
• Ability to Participate in Employee Stock Purchase Program (ESPP)
• Mental Wellness Benefits through Spring Health
• Family-Forming support provided by Carrot
• Paid Parental Leave
• Flexible, full-service childcare support with Kinside
• 401(k) with a generous employer match
• Flexible PTO
• Catered lunch each day in our office and data center locations
• A casual work environment
• A work culture focused on innovative disruption

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Industry: Professional, Scientific, and Technical Services
• Education Level: Master's degree