Lead Data Engineer

KenectPleasant Grove, AL
67d

About The Position

As the Lead Data Engineer, you will lead the development of Kenect’s data ecosystem, including architecting and implementing a customer data platform. This platform will unify batch and real-time data from sources such as DMS, CRMs, social networks, and web traffic to create comprehensive 360-degree customer profiles. You will work closely with a product manager to ensure the data initiatives are aligned with the product roadmap, building the right data products that are prioritized to deliver customer-facing value. Together with engineers, analysts, and data scientists, you will enable data-driven insights and power advanced digital initiatives like real-time personalization, predictive modeling, and targeted marketing campaigns. In this role, you will help to define the architecture, tools, and strategy for data pipelines, data lakes, cloud data warehousing, and integrations with marketing automation tools. Your work will directly support Kenect’s mission to transform the customer experience at tens of thousands of dealerships.

Requirements

  • 8+ years of professional experience in data engineering, with a focus on batch and streaming data architectures.
  • Expertise in building scalable data pipelines and data processing frameworks.
  • Proficiency in Python and modern ETL tools like GCP Cloud Dataflow, Fivetran, dbt, and Apache Spark.
  • Experience with cloud-based data platforms (e.g., BigQuery, Snowflake, Redshift, Databricks).
  • Strong understanding of CDPs and tools like Twilio Segment or RudderStack.
  • Hands-on experience with streaming tools like GCP Pub/Sub, Kafka, or AWS SNS is highly desirable.
  • Experience with multi-tenant SaaS architecture is a strong plus.
  • Excellent communication skills and a collaborative approach to solving complex problems.

Responsibilities

  • Designing and implementing scalable batch and real-time data pipelines using tools like Fivetran, dbt, Apache Spark, and Airflow.
  • Architecting and managing a data lake and cloud data warehouse solutions (e.g., BigQuery, Redshift, Snowflake, Databricks).
  • Building and optimizing streaming data pipelines with tools such as GCP Pub/Sub, Kafka, or AWS SNS to support real-time data processing.
  • Developing integrations with Customer Data Platforms (e.g., Twilio Segment, RudderStack) and marketing automation systems.
  • Collaborating with engineers, analysts, and data scientists to build data solutions that support advanced use cases like real-time personalization, predictive scoring, and segmentation.
  • Ensuring all data initiatives are aligned with the product roadmap and prioritized to deliver measurable value for customers.
  • Defining strategies for multi-tenant SaaS data solutions to ensure scalability, performance, and security.
  • Leading technical initiatives to adopt new technologies and best practices for data engineering.
  • Ensuring data quality, governance, and compliance with industry standards and regulations.

Benefits

  • Health, Dental, Vision, Life & Disability Insurance
  • Your birthday is a paid day off
  • Onsite gym
  • Breakroom full of snacks and drinks
  • Convenient location next to freeway entrance/exit
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service