Senior Kafka Administator

Softheon-posted about 1 year ago
$115,000 - $130,000/Yr
Full-time • Mid Level
Stony Brook, NY
Professional, Scientific, and Technical Services
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

The Senior Kafka Administrator will manage and optimize the distributed Kafka ecosystem at Softheon, ensuring high availability, data integrity, and security. This role involves configuring, troubleshooting, and implementing best practices for Kafka environments while collaborating with development teams to meet business requirements and enhance performance.

  • Design, install, configure, and manage Kafka clusters, including brokers, ZooKeeper, Kafka Connect, and Kafka Streams.
  • Optimize Kafka infrastructure to ensure high availability, scalability, and low latency.
  • Implement high availability configurations for Kafka to minimize downtime.
  • Design and implement disaster recovery strategies, ensuring data replication and failover mechanisms are functioning properly.
  • Set up and maintain Kafka backup procedures to ensure data integrity and availability.
  • Ensure Kafka is secured, including encrypting data at rest and in transit.
  • Implement access control mechanisms, including SSL/TLS encryption and client authentication using Kerberos or SASL.
  • Monitor the health and performance of Kafka clusters, ensuring that alerts and logs are actively tracked for any anomalies.
  • Tune Kafka parameters to enhance throughput, latency, and reliability.
  • Utilize tools such as Prometheus, Grafana, or similar to monitor Kafka infrastructure.
  • Perform routine maintenance, including upgrading Kafka brokers, patches, and handling schema updates.
  • Troubleshoot Kafka-related issues such as performance degradation, replication lag, and consumer/producer errors.
  • Collaborate with software engineering, DevOps, and other stakeholders to integrate Kafka into the broader system architecture.
  • Document Kafka cluster configurations, procedures, and best practices.
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 3+ years of experience in managing and administering Apache Kafka in a production environment.
  • Strong knowledge of Kafka architecture, including brokers, ZooKeeper, Kafka Connect, and Kafka Streams.
  • Experience in high availability and disaster recovery configurations for Kafka clusters.
  • Experience with security best practices, including SSL/TLS encryption, SASL, and Kerberos.
  • Proficiency in monitoring Kafka with tools like Prometheus, Grafana, or similar.
  • Solid understanding of distributed systems, networking, and data flow management.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication skills (written and verbal).
  • Base compensation for this role is $115,000-$130,000 per year.
  • Work from home with a one-time home office stipend.
  • Excellent benefits package including health, vision, and dental coverage for you, your spouse, and dependents.
  • Monthly wellness stipend and internet stipend.
  • 401K with a match; immediately vested.
  • Employee assistance program and disability insurance.
  • Parental leave.
  • 15 days to unlimited PTO based on years of service plus 9 additional holidays.
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Kafka Developer Resume Examples
•
Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service