Lead Data Engineer

Adelaide

3d•Hybrid

About The Position

This position reports to the Director of Engineering, DevOps & Data Engineering and is responsible for the design, reliability, and performance of Adelaide's data pipelines and data infrastructure. The role supervises one Data Engineer. In this role, you'll work with a team of data engineers and data scientists to structure and maintain the network of data that flows from internal and external sources into our SaaS analytics dashboard and connected platforms. This role is based in New York, NY, with flexible work options.

Requirements

Bachelor's degree in Computer Science
Proficiency in Python, Redshift, Postgres, SQL, Spark, Scala, and Airflow
Experience with the Pandas library and Docker
Familiarity with AWS technologies such as ECS, S3, Kinesis, Redshift, and EMR
Strong understanding of data structures and algorithms
Experience with machine learning
Passion for delivering high-quality, reliable data solutions

Nice To Haves

Experience in ad tech, measurement, or verification
Experience with high-throughput or near-real-time data pipelines
Experience with Snowflake or Looker

Responsibilities

Structure a sophisticated network and pipeline of data across internal and external sources
Maintain a high degree of uptime for our SaaS analytics dashboard and connected platforms
Work with other team members to design, build, deploy, and maintain reliable data pipelines
Maintain and optimize existing data pipelines and integrations
Optimize our data stores for fast, efficient querying to support technology and reporting needs
Ensure the quality, reliability, and security of our data infrastructure