Staff Software Engineer, Streaming

Judi Health•Charlotte, NC

1d•Hybrid

About The Position

Judi Health is building the technology infrastructure our nation needs to deliver the healthcare we deserve. The Architecture organization is responsible for the technical foundation the rest of the company builds: the standards, patterns, and infrastructure that engineering teams use to move fast and build efficiently. The Realtime & Streaming team sits within Architecture's Core Platform function, owning the streaming infrastructure that services and data consumers depend on for timely, correct event delivery. As a Staff Engineer in Architecture, your influence extends beyond what you ship directly. The standards you set, the patterns you establish, and the decisions you document become the reference point for how event-driven systems are built across the organization. The platform's consumers, including cache invalidation systems, analytics pipelines, and change-data-capture subscribers, each carry different latency and ordering requirements. You will be directly responsible for scaling delivery without degrading it while honoring per-consumer SLAs as volume grows to keep historical and real-time data in sync. One of your first major initiatives will be leading the migration of our data warehouse synchronization layer from independently managed, batch-driven processes to a unified WAL-based replication pipeline, using an open table format for transactional data. This spans the full synchronization path from PostgreSQL to the downstream data warehouses used for analytics leveraging native streaming and ingestion capabilities to support realtime synchronization.

Requirements

10+ years of production engineering experience, with deep specialization in realtime data infrastructure and event streaming systems
Production experience designing and operating WAL-based or log-structured replication systems, such as PostgreSQL logical replication, Debezium, Kafka Connect, or equivalent CDC frameworks at scale with an understanding of delivery guarantees, consumer lag management, and failure recovery
Deep understanding of event streaming correctness: ordering guarantees, at-least-once vs. exactly-once delivery semantics, idempotency requirements, and how those properties propagate to downstream consumers
Experience leading batch-to-streaming migrations replacing polling or batch-driven synchronization with event-driven architectures without disrupting dependent consumers
Fluency in a systems-level language (Rust, Go, or C/C++) used to build high-throughput, low-latency data plane components in production
A track record of leading cross-team technical initiatives — driving decisions through influence and producing documentation that holds up over time
Strong written and verbal communication — you produce architectural guidance that the broader engineering organization depends on
Comfortable operating with ambiguity — at this level, you will be handed problems, not plans, and are expected to identify the right approach and drive it from first principles to production
Strong experience supporting 24/7 production on-call rotations, including responding to alerts and resolving incidents outside of standard business hours

Nice To Haves

Systems-level programming experience in Rust for high-throughput streaming pipeline components, such as binary protocol handling, I/O-intensive services, or data plane infrastructure where performance and correctness are both hard constraints
Experience with open table formats (Apache Iceberg, Delta Lake, Parquet) as the storage layer bridging streaming ingestion and analytical query workloads
Hands-on experience integrating streaming pipelines with analytical query engines — Redshift, Snowflake, BigQuery, ClickhHouse, DataBricks — including schema evolution, backfill strategies, and latency and cost trade-offs
Deep familiarity with PostgreSQL WAL internals, including logical decoding, replication slots, checkpointing, and the failure modes that emerge at scale
Familiarity with the streaming runtime landscape — Kafka, Kinesis, Redpanda, Pulsar, and similar — and the ability to evaluate trade-offs across managed and self-managed deployment models
Experience with AWS data infrastructure and how managed services compose with self-managed streaming components in a hybrid architecture
Background in healthcare, pharmacy, financial services, or other regulated domains where data pipelines carry audit and correctness obligations

Responsibilities

Design, build, and operate the WAL replication and event streaming platform that cache invalidation, data warehouse synchronization, and change-data-capture consumers across the platform depend on for correctness and low latency
Own the full lifecycle of the streaming platform, from replication topology and delivery guarantee design through operational recovery and post-incident review
Define and own the performance and correctness contracts between the streaming platform and the services that depend on it
Lead the migration of batch-driven data warehouse synchronization to a unified WAL-based replication pipeline, establishing an open table format as the canonical source and replacing independently managed sync processes
Drive adoption of event-driven design best practices across engineering by eliminating anti-patterns, producing architectural guidance, and making correct consumption of the streaming platform the default
Set the technical bar for the Realtime & Streaming team through design review, code review, and direct mentorship of senior engineers
Participate in a 24/7 on-call rotation to provide continuous operational support and rapid incident response