Streaming Data Engineer
About The Position
Bright Vision Technologies is seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent Platform environments that support mission-critical event-driven workloads. The engineer will own the Kafka platform end to end, including cluster sizing, configuration, security, automation, observability, and developer enablement. The role combines deep Kafka internals knowledge with DevOps and SRE practices to deliver a reliable, performant, developer-friendly streaming platform. The engineer will work with product, design, engineering, operations, and business stakeholders to turn ambiguous requirements into well-engineered solutions. The role also includes contributing through code reviews and design reviews, mentoring more junior engineers, and communicating clearly while delivering production-ready work. The position is full-time, direct W2, and 100% remote within the United States.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- Five or more years of experience operating Apache Kafka or Confluent Platform in production.
- Deep hands-on knowledge of Kafka internals, including partitions, replication, ISRs, and consumer groups.
- Strong experience with Kafka security, including SASL, mTLS, ACLs, and RBAC.
- Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
- Experience with high-availability and disaster-recovery strategies for Kafka.
- Strong scripting skills in Python, Bash, or Go.
- Hands-on experience with infrastructure as code, including Terraform or Ansible.
- Working knowledge of Kafka observability tooling.
- Excellent troubleshooting, communication, and documentation skills.
Nice To Haves
- Confluent Certified Administrator or Developer credentials.
- Experience operating Kafka on Kubernetes, such as with Strimzi or Confluent Operator.
- Exposure to managed Kafka services, such as AWS MSK or Azure Event Hubs Kafka API.
- Familiarity with stream processing frameworks such as Flink or Spark Streaming.
- Experience with data governance and lineage for streaming data.
Responsibilities
- Architect, deploy, and operate large-scale Apache Kafka and Confluent Platform environments.
- Own the Kafka platform end to end, including cluster sizing, configuration, security, automation, and observability.
- Enable developers and partner with application teams to deliver a reliable, performant streaming platform.
- Collaborate with product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into solutions.
- Participate in code reviews and design reviews.
- Mentor more junior engineers.
- Troubleshoot Kafka and streaming platform issues and provide clear communication and documentation.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
