Kafka Engineer Consultant

First Citizens Bank • Raleigh, NC

7d

About The Position

This position provides technical guidance on complex strategic projects for Kafka Platform team. Facilitates the design, development and maintenance of data streaming pipelines and distributed messaging system. Responsible for setting up Kafka clusters, configuring brokers, performance optimization and ensuring high availability. Consults on software evaluations, feasibility studies, and new technologies. Recommends processes and products that meet strategic goals while aligning with the Bank's long-term technology direction.
This position provides technical guidance on complex strategic projects for Kafka Platform team. Facilitates the design, development and maintenance of data streaming pipelines and distributed messaging system. Responsible for setting up Kafka clusters, configuring brokers, performance optimization and ensuring high availability. Consults on software evaluations, feasibility studies, and new technologies. Recommends processes and products that meet strategic goals while aligning with the Bank's long-term technology direction.

Requirements

• Bachelor's Degree and 8 years of experience in Software Application Development and Maintenance OR High School Diploma or GED and 12 years of experience in Software Application Development and Maintenance
• Strong understanding of Kafka architecture – topics, partitions, brokers, producers, consumers, connectors.
• Knowledge of distributed systems, data streaming and messaging systems.
• Experience with Confluent Kafka Connect, streams. Monitoring tools like, Grafana, Prometheus, Confluent Control Center.
• Ability to be on call for support on a rotating basis (as needed).

Nice To Haves

• Preferred Area of Study: Computer Science, Information Systems
• Preferred Area of Experience: Information Technology, Kafka Development

Responsibilities

• Infrastructure Management – Design and deploy Kafka clusters on premise to ensure scalability and high availability. Cluster management through capacity planning, monitoring and alerting.
• Pipeline Development – Develop and Maintain real-time, stream data pipes using Kafka connect, schema registry, streams, ksqldb.
• Performance Optimization - Monitor, tune and optimize brokers and topic configurations for throughput and low latency.
• Technical Expert - Maintains a strong knowledge of technology trends and impact on the Bank's infrastructure to provide relevant consultative guidance. Trains and mentor peers on new technologies.
• Consultation - Provides technical advice and direction to associates, management, and developmental project teams. Utilizes expertise to consult and develop software to solve complex technical problems.
• Business Strategy - Acts as a trusted advisor on strategies that align developmental projects with long-term business needs and technological direction. Assists management in implementing initiatives or strategies across the division.
• Troubleshooting – Diagnose and work of remediations for issues related to infrastructure, consumer lags and message delivery.
• Security and Governance – Secure Kafka cluster via SSL and SASL, Manage data contracts using schema registry.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level