Streaming Data Engineer

Bright Vision Technologies • Artesia, CA

1d • $78,000 - $105,000 • Remote

About The Position

Bright Vision Technologies is seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments for mission-critical event-driven workloads. The engineer will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement. The role combines deep Kafka internals knowledge with DevOps and SRE practices, while partnering with application teams to deliver a reliable, performant, and developer-friendly streaming platform.

The engineer will work with product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into well-engineered solutions. The position also involves contributing to code and design reviews and mentoring more junior engineers. The successful candidate will demonstrate engineering discipline, clear communication, and a track record of delivering production-ready work.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of experience operating Apache Kafka or Confluent Platform in production.
• Deep, hands-on knowledge of Kafka internals, including partitions, replication, ISRs, and consumer groups.
• Strong experience with Kafka security, including SASL, mTLS, ACLs, and RBAC.
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience with high-availability and disaster-recovery strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands-on experience with infrastructure as code, such as Terraform or Ansible.
• Working knowledge of Kafka observability tooling.
• Excellent troubleshooting, communication, and documentation skills.

Nice To Haves

• Confluent Certified Administrator or Developer credentials.
• Experience operating Kafka on Kubernetes, including Strimzi or Confluent Operator.
• Exposure to managed Kafka services, including AWS MSK or Azure Event Hubs Kafka API.
• Familiarity with stream-processing frameworks such as Flink or Spark Streaming.
• Experience with data governance and lineage for streaming data.

Responsibilities

• Architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments.
• Own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.
• Partner with application teams to provide a reliable, performant, developer-friendly streaming platform.
• Work with cross-functional partners to translate ambiguous requirements into well-engineered solutions.
• Contribute to code reviews and design reviews.
• Mentor more junior engineers.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior