Manager, Data Engineering

Purchasing Power-posted 4 months ago
Full-time • Manager
Atlanta, GA
251-500 employees
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

The Manager of Data Engineering will lead our data platform team in building and scaling enterprise-grade streaming data architectures. You will be a technical leader with deep expertise in the Confluent platform, Apache Kafka, and modern data engineering practices. This role will be responsible for managing a team of data engineers while driving the strategic direction of our real-time data infrastructure.

  • Lead, mentor, and develop a team of 2-3 data engineers specializing in streaming technologies
  • Provide technical guidance on complex streaming architectures and best practices
  • Conduct performance reviews, career development planning, and technical skill assessments
  • Foster a culture of innovation, collaboration, and continuous learning
  • Define and execute the data engineering roadmap with a focus on real-time streaming platforms
  • Design and oversee the implementation of event-driven architectures using Confluent Platform
  • Establish best practices for stream processing, data governance, and platform reliability
  • Drive platform modernization initiatives and technology adoption decisions across streaming and batch systems
  • Architect integrations between streaming platforms (Kafka) and analytics platforms (Databricks, Snowflake)
  • Collaborate with stakeholders to translate business requirements into scalable technical solutions
  • Oversee the management and optimization of Kafka clusters and Confluent Platform deployments
  • Ensure high availability, performance, and scalability of streaming data pipelines
  • Manage platform capacity planning and cost optimization initiatives
  • Demonstrate experience with monitoring tools (JMX metrics, Grafana, Prometheus) for Kafka environments
  • Demonstrate understanding of data lakehouse architectures and multi-platform integration patterns
  • Successfully manage teams through platform migrations or modernization projects
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or related technical field
  • 2+ years of people management experience leading technical teams
  • 5+ years of hands-on data engineering experience with distributed systems
  • Deep expertise in Confluent Platform including Kafka Connect, Schema Registry, ksqlDB, and Control Center
  • Proficiency in Kafka cluster sizing, scaling, and performance optimization
  • Advanced proficiency in Apache Kafka: stream processing, topic design, partitioning strategies, consumer groups, and performance tuning
  • Extensive experience with Apache Airflow for workflow orchestration, DAG development, and pipeline monitoring
  • Expert-level skills in PySpark for large-scale data processing, performance optimization, and cluster management
  • Strong communication skills for working with technical and business stakeholders
  • Proven experience designing event-driven architectures and real-time data pipelines
  • Hybrid work model (Onsite/Offsite)
  • Comprehensive benefits: medical, dental, vision, company paid Basic Life/AD&D
  • 401k Retirement Plan
  • Flexible PTO
  • Career Development
  • Employee Purchase Program
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Data Engineering Manager Resume Examples
•
Data Engineering Manager Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service