Kafka and Streaming Engineer

Pellera

3d•Remote

About The Position

We are seeking an experienced to senior engineer or architect who has worked with Kafka and related streaming technologies. This role will be focused on developing, improving and supporting solutions in the streaming integration domain. The Kafka/EDA Engineer is responsible for the development of Kafka based applications for our clients. The role includes doing the intermediate to low level design and development of applications, within an architecture pattern established by a senior architect. It includes not just Java development, but also Kafka/Confluent platform tools such as Kafka Connect, Apache Flink, and Kafka Streams. The Kafka/EDA Engineer role’s involvement in opportunities will start following initial architecture design work, and continue through the remainder of the SDLC (design, development, testing, deployment). This role is well-suited for someone who enjoys consulting work, variety across client engagements, and balancing modern data engineering practices with high-quality, business-facing analytics delivery.

Requirements

At least three (3) years of Information Technology related work experience in an integration focused Java development role
Strong experience with source code management (ex. Git)
Experience with Java build concepts and tooling (ex. Gradle, Maven)
Strong capabilities in Spring Boot
Strong experience with Kafka / Confluent Platform
Experience working with Java-Kafka integrations using Kafka-Client and/or Kafka-Streams
Experience with Kafka Connect, Flink
Experience with Avro
Understanding of EDA concepts

Nice To Haves

Confluent certification
Experience administrating a Kafka environment
Kubernetes experience
Experience in integration sales support (ex. Developing/demonstrating PoC solutions)
Experience with cloud platforms such as Azure, AWS and GCP

Responsibilities

Performs detailed design of solution components in an EDA solution
Works with architects to understand the context, patterns, technology choices, and integrations
Design and develop appropriate schemas for events
Documents design based on business and technical requirements
Works with client to understand detailed requirements and fill in or raise awareness of gaps where necessary
Provides solution feedback to architecture team as needed
Designs Kafka related items such as topics and their configurations
Develops Java microservices and applications to meet functional and nonfunctional requirements
Develops Flink streaming applications
Configures and deploys connectors to integrate with external systems
Understands Kubernetes basics of deployment and containerization
Works with CI/CD platforms and other deployment/configuration platforms to deploy and run solutions
Analyzes and addresses bugs as raised
Design and implement appropriate infrastructure for business needs, including analysis of reliability, availability, durability and performance
Translate business requirements into technical designs and development plans.
Perform unit and integration testing; validate results with stakeholders to ensure accuracy, usability, and performance.
Troubleshoot and resolve data issues, report defects, and performance bottlenecks; provide ongoing production support and enhancements.