Senior Confluent Kafka Developer

CHS•Inver Grove Heights, MN

2d•Onsite

About The Position

Genesis10 is seeking an experienced Confluent Cloud Kafka Developer to design, develop, and manage scalable, real-time data streaming solutions using Apache Kafka on Confluent Cloud. The ideal candidate will work with data engineering teams to architect streaming data pipelines, integrate diverse data sources, and optimize Kafka for high-performance applications. This role requires strong expertise in Apache Kafka, Confluent Cloud, and distributed streaming platforms, with a focus on real-time integrations.

Requirements

3+ years of experience in software development, with a strong focus on Apache Kafka development and distributed systems
2+ years of experience in Python for building Kafka applications
Proven experience with Confluent Kafka, including Schema Registry
Experience with Infrastructure as Code (IaC) tools, particularly Terraform
Hands-on experience with AWS services (e.g., EC2, S3, IAM, Lambda)
Solid understanding of data integration, ETL processes, and data pipeline orchestration
Experience with operational monitoring and performance optimization of streaming pipelines
Ability to troubleshoot and resolve complex technical issues related to Kafka and its ecosystem
Strong analytical and problem-solving skills, with attention to detail
Excellent verbal and written communication skills
Ability to work effectively in a team environment and collaborate with cross-functional teams

Nice To Haves

2+ years of experience working with Confluent Cloud and implementing Kafka-based solutions
Proficiency with Apache Flink, ksqlDB, and Kafka Connect for real-time data processing and integration
Working knowledge of Snowflake for data warehousing and analytics in cloud environments
Strong programming skills in Java, with the ability to build and maintain scalable, event-driven applications
Experience with other data streaming tools or platforms is a plus
Familiarity with DevOps practices and tools, including CI/CD pipelines, Docker, and Kubernetes, for building and deploying modern cloud-native applications
Certifications in AWS, Apache Kafka, or related cloud and data streaming technologies are highly desirable

Responsibilities

Develop, implement, and manage streaming data pipelines using Confluent Kafka and Apache Flink
Collaborate with data engineering teams to integrate streaming solutions with existing data platforms such as AWS and Snowflake
Design, build, and maintain real-time data pipelines and ensure high data quality, integrity, and reliability
Utilize Terraform to manage and automate code deployments on AWS or other cloud environments
Develop and maintain CI/CD pipelines for deploying and managing Kafka clusters and related infrastructure
Collaborate with development, DevOps, and data science teams to understand data needs and deliver optimal solutions
Provide support and guidance on Kafka-related issues and best practices for other teams
Stay updated with the latest Kafka and streaming technologies and provide recommendations for improvements

Benefits

Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years
The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years
Access to an experienced, caring recruiting team (more than 7 years of experience, on average)
Behavioral Health Platform
Medical, Dental, Vision
Health Savings Account
Voluntary Hospital Indemnity (Critical Illness & Accident)
Voluntary Term Life Insurance
401K
Sick Pay (for applicable states/municipalities)
Commuter Benefits (Dallas, NYC, SF, and Illinois)