Kafka Data Engineer

Booz Allen Hamilton•Missouri City, TX

1d•$77,600 - $176,000•Remote

About The Position

Ever-expanding technology and collection methodologies means that there is more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it is gathered from disparate sources. We need a Data Engineer who is experienced in upgrading and maintaining Kafka clusters in Kubernetes in AWS, as well as utilizing Kafka Schema Registry and Kafka Security Manager (KSM) to manage schema evolution and security. In this role, you'll use your expertise in designing, developing, and deploying Kafka clusters in a cloud environment, and with Kafka Schema Registry and Kafka Security Manager. Here, you will guide and mentor data engineers, developers, and data consumers in a fast-paced, agile environment and will oversee the assessment, design, building, and maintenance of scalable platforms for your clients. Join us. The world can't wait.

Requirements

Experience with Kafka
Experience creating data partitioning strategies and monitoring topics for performance
Experience deploying and upgrading Kafka clusters in high availability containerized environments
Experience utilizing observability platforms such as Elastic or Datadog to configure monitoring for data pipelines to ensure high availability and throughput, low latency, and alerting
Knowledge of stream processing pipelines and analytics
Secret clearance
HS diploma or GED

Nice To Haves

Experience with Apache NiFi
Experience with multi-cluster or containerized environments
Experience with scripting in Bash or Python
Experience deploying and maintaining applications, appliances, or machines aligned to DoD Security Technical Implementation Guidelines (STIG) and Security Requirements Guides (SRG)
Experience writing playbooks and scripts for automation tools, including Terraform, Ansible, or Puppet for Infrastructure as Code (IaC) and Configuration as Code (CaC)
Knowledge of cybersecurity concepts, including threats, vulnerabilities, security operations, encryption, boundary defense, auditing, authentication, and supply chain risk management
Bachelor’s degree
DoD 8570 IAT Level II Certification such as Security+, CCNA Security, or GSEC Certification

Responsibilities

Upgrading and maintaining Kafka clusters in Kubernetes in AWS
Utilizing Kafka Schema Registry and Kafka Security Manager (KSM) to manage schema evolution and security
Designing, developing, and deploying Kafka clusters in a cloud environment
Guiding and mentoring data engineers, developers, and data consumers
Overseeing the assessment, design, building, and maintenance of scalable platforms