Streaming Data Engineer

Bright Vision Technologies • Sunnyvale, CA

3d • $78,000 - $105,000 • Remote

About The Position

We are seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads. In this role you will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement. The ideal candidate will combine deep Kafka internals knowledge with strong DevOps and SRE practices, and will partner with application teams to deliver a reliable, performant, and developer-friendly streaming platform. In this role you will work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering discipline, a clear communication style, and a track record of shipping meaningful work that holds up well in production.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of experience operating Apache Kafka or Confluent Platform in production.
• Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
• Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands-on experience with infrastructure-as-code (Terraform, Ansible).
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.

Nice To Haves

• Confluent Certified Administrator or Developer credentials.
• Experience operating Kafka on Kubernetes (Strimzi, Confluent Operator).
• Exposure to managed Kafka services (AWS MSK, Azure Event Hubs Kafka API).
• Familiarity with stream processing frameworks (Flink, Spark Streaming).
• Experience with data governance and lineage for streaming data.

Responsibilities

• Architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments.
• Own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.
• Partner with application teams to deliver a reliable, performant, and developer-friendly streaming platform.
• Work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions.
• Raise the bar through code review, design review, and mentorship of more junior engineers.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior