Manager, Data Engineering

Purchasing Power • Atlanta, GA

186d

About The Position

The Manager of Data Engineering will lead our data platform team in building and scaling enterprise-grade streaming data architectures. You will be a technical leader with deep expertise in the Confluent platform, Apache Kafka, and modern data engineering practices. This role will be responsible for managing a team of data engineers while driving the strategic direction of our real-time data infrastructure.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or related technical field
• 2+ years of people management experience leading technical teams
• 5+ years of hands-on data engineering experience with distributed systems
• Deep expertise in Confluent Platform including Kafka Connect, Schema Registry, ksqlDB, and Control Center
• Proficiency in Kafka cluster sizing, scaling, and performance optimization
• Advanced proficiency in Apache Kafka: stream processing, topic design, partitioning strategies, consumer groups, and performance tuning
• Extensive experience with Apache Airflow for workflow orchestration, DAG development, and pipeline monitoring
• Expert-level skills in PySpark for large-scale data processing, performance optimization, and cluster management
• Strong communication skills for working with technical and business stakeholders
• Proven experience designing event-driven architectures and real-time data pipelines

Responsibilities

• Lead, mentor, and develop a team of 2-3 data engineers specializing in streaming technologies
• Provide technical guidance on complex streaming architectures and best practices
• Conduct performance reviews, career development planning, and technical skill assessments
• Foster a culture of innovation, collaboration, and continuous learning
• Define and execute the data engineering roadmap with a focus on real-time streaming platforms
• Design and oversee the implementation of event-driven architectures using Confluent Platform
• Establish best practices for stream processing, data governance, and platform reliability
• Drive platform modernization initiatives and technology adoption decisions across streaming and batch systems
• Architect integrations between streaming platforms (Kafka) and analytics platforms (Databricks, Snowflake)
• Collaborate with stakeholders to translate business requirements into scalable technical solutions
• Oversee the management and optimization of Kafka clusters and Confluent Platform deployments
• Ensure high availability, performance, and scalability of streaming data pipelines
• Manage platform capacity planning and cost optimization initiatives
• Demonstrate experience with monitoring tools (JMX metrics, Grafana, Prometheus) for Kafka environments
• Demonstrate understanding of data lakehouse architectures and multi-platform integration patterns
• Successfully manage teams through platform migrations or modernization projects

Benefits

• Hybrid work model (Onsite/Offsite)
• Comprehensive benefits: medical, dental, vision, company paid Basic Life/AD&D
• 401k Retirement Plan
• Flexible PTO
• Career Development
• Employee Purchase Program

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: Bachelor's degree
• Number of Employees: 251-500 employees