Senior Software Engineer
About The Position
Solace is building Solace Diskless Streaming for Apache Kafka® (SSK), based on Nisshi Diskless Streaming for Apache Kafka®, an open-source project licensed under Apache-2.0. The systems implement the Apache Kafka® protocol and separate compute from storage: stateless Protocol Engines scale horizontally, while data is stored in object storage rather than on local disks. The role focuses on developing and maintaining core data-path components for a system where writes must remain correct under heavy concurrent load. Work spans wire protocols, storage engines, and coordination to preserve ordering and consistency across stateless engines. The team prioritizes scale, security, latency, and robustness, and tunes tail latency, throughput, and cost per byte. The engineer will own parts of the data path end to end in Rust and contribute to the Nisshi project in public.
Requirements
- Deep hands-on experience building a high-throughput, log-based streaming or messaging system, such as Apache Kafka® or a comparable platform, including wire protocols, client/server compatibility, and system internals; or deep experience with database internals such as storage engines, write-ahead or commit logs, replication and consensus, or query execution.
- Strong systems-programming fundamentals in Rust, C++, Go, or Java.
- A track record of owning difficult technical problems end to end, from design through production.
- Comfort working remotely and asynchronously across time zones.
Nice To Haves
- Production experience in Rust.
- Working knowledge of the Apache Kafka® protocol, client libraries, and ecosystem.
- Hands-on experience with the internals of a system such as Apache Kafka®, Redpanda, Pulsar, WarpStream, NATS JetStream, or Solace Event Broker.
- Experience running one of these systems at production scale.
- Experience with security hardening, fuzzing, or performance engineering of network services.
Responsibilities
- Design and build core data-path components for request handling and storage while maintaining strict ordering guarantees under load.
- Implement and evolve Apache Kafka® wire-protocol handling, including parsing, framing, versioning, and backward compatibility with Apache Kafka® client libraries.
- Build and harden storage engines, including offset and sequence coordination, compaction, retention, and correctness under concurrent access.
- Diagnose races, consistency edge cases, and security or robustness issues that emerge under real concurrent load.
- Profile and tune throughput and latency against measured production numbers.
- Review, discuss, and contribute to the Nisshi open-source community.
Benefits
- Training programs designed to support employee growth.
- Hybrid-first work flexibility.
- Work-life balance.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
