Principal Engineer - Observability Telemetry Client Infrastructure

Cloudera•Austin, TX

8d•Hybrid

About The Position

Cloudera is seeking a Principal Engineer to serve as the primary architect and visionary for our Observability Telemetry client interactions framework as we build a multi-tenant, high-throughput telemetry fabric to support the world’s largest data estates. In this role, you will lead the evolution of Cloudera’s Observability product by designing and building a "self-service" Open Telemetry-based ecosystem that allows internal clients to integrate telemetry data seamlessly for multiple downstream consumers. You will architect the self-service interfaces that allow thousands of distributed components to emit high-cardinality logs, metrics, and traces that are automatically correlated, context-aware, and ready for downstream analysis in ClickHouse and other massive-scale engines. You will be Cloudera’s voice in the CNCF/OTel community, influencing the direction of open-source observability to meet the needs of hybrid-cloud data platforms. As a technical leader, you will be responsible for defining the semantic conventions to enable log events, metrics, spans, and traces from diverse, multi-language clients to be correlated into a unified, actionable view for customers, Support and Cloudera product engineering. This data is the foundation for troubleshooting, forecasting, workload analysis, financial governance, and other administrative functions. You will also work closely with open source products for integration and can influence OTel integration directions in the open source ecosystem for these components This position is a high-visibility role requiring a blend of deep systems architecture, hands-on implementation, and cross-organizational influence to ensure our telemetry infrastructure scales with the world’s most complex data workloads. This role is not eligible for immigration sponsorship.

Requirements

10+ years of experience (or equivalent advanced degree + experience) designing and maintaining large-scale distributed systems and observability platforms.
A proven track record of designing and shipping complex, critical features that serve as foundational infrastructure for other engineering teams.
Deep, hands-on experience with the OpenTelemetry Collector architecture, custom processors, and the challenges of high-cardinality data.
Experience with high-volume OLAP engines (e.g., ClickHouse, StarRocks) and an understanding of how to structure telemetry data for sub-second queries at large scale.
Excellent communication and collaboration skills and the ability to build relationships across the company to drive adoption of new standards and remove technical roadblocks.
The ability to map business requirements to technical roadmaps, ensuring our observability tools support Cloudera’s long-term strategic goals.
Experience coaching senior and staff-level engineers, acting as a "force multiplier" for a technical organization.
Bsc/Msc in related field or equivalent experience

Nice To Haves

Significant contributions to major observability or data projects (e.g., CNCF or Apache projects).
Bonus points if you’re already a CNCF OTel maintainer.
Deep experience with Kubernetes-native observability and managing telemetry at scale in hybrid-cloud environments.
Experience representing technical initiatives at industry conferences or internal company-wide summits.
Experience using machine learning or advanced analytics to derive "AIOps" insights from raw telemetry data.

Responsibilities

Architect and drive the implementation of automated "on-ramps" for observability clients that handles the complexity of multi-cloud, hybrid environments without sacrificing performance, ensuring teams can integrate their services with minimal friction.
Establish and enforce the semantic conventions needed to ensure telemetry data carries the appropriate context for easy correlation across the entire Cloudera stack.
Develop and support high-performance interfaces and SDKs for clients across various languages (Java, Go, Python, etc.) to contribute high-fidelity signals.
Build the logic to stitch together disparate signals into a unified trace, enabling deep-dive workload analysis and financial governance across massive distributed systems.
Work alongside engineering teams to turn architectural blueprints into production reality, conducting deep-dive code reviews and resolving complex systemic bottlenecks.
Serve as the "go-to" expert for observability, resolving technical disagreements and making high-stakes decisions on the future of our telemetry platform.