Director, Data Engineering

$160,000 - $185,000/Yr

Last.Fm - New York, NY

Full-time - Senior

New York, NY

About the position

As the Director of Data Engineering within the Ad Platforms division, you will lead and develop the Identity and Audience Data Engineering team. This role is responsible for architecting and managing scalable data platforms that drive Paramount's advertising solutions, requiring a combination of technical leadership, hands-on engineering, and an advanced understanding of cloud-based data architectures. You will collaborate closely with product owners, partners, and other engineering teams to deliver reliable data solutions that align with business needs, playing a pivotal role in advancing the company's data-driven advertising initiatives.

Responsibilities

• Lead, coach, and mentor a team of data engineers, promoting a culture of teamwork, innovation, and continuous improvement.
• Develop and implement a strategic roadmap for data engineering that aligns with the company's business goals, focusing on the design and optimization of large-scale data pipelines and architectures.
• Architect, build, and optimize scalable data platforms to support identity and audience solutions using technologies such as Databricks, AWS, GCP (BigQuery, DataProc), and Snowflake.
• Collaborate with partners to understand complex business requirements, translating them into scalable and reliable data products and solutions.
• Lead all aspects of the development of automated testing frameworks and establish CI/CD practices to ensure high-quality code and deployments.
• Set and carry out engineering standards, including coding practices, data management, and security protocols, ensuring compliance with regulatory requirements.
• Build collaboration with multi-functional teams in product, engineering, and business units to deliver data-driven insights and solutions.
• Keep aware of industry trends in data engineering and drive the adoption of standard processes and new technologies within the team.

Requirements

• 6+ years of experience in data engineering, with at least 2 years in a leadership or team management role, preferably in the media or advertising industry.
• Shown expertise in building and maintaining large-scale, distributed data systems using cloud platforms (Databricks, OCI, AWS, GCP, Snowflake).
• Confirmed proficiency in Python, PySpark, and SQL, with a deep understanding of data processing frameworks and large-scale distributed systems.
• Experience with identity and audience data management systems, particularly in the context of digital advertising technologies.
• Proven track record of optimally delivering projects in a fast-paced environment with tight deadlines.
• Bachelor's degree or equivalent experience in Computer Science, Engineering, or a related technical field (Master's preferred).
• Strong problem-solving, communication, and leadership skills, with the ability to influence technical and non-technical partners.

Nice-to-haves

• Hands-on experience with real-time data processing, machine learning pipelines, and advanced analytics.
• Familiarity with agile development methodologies and tools such as JIRA, Confluence, and Git.
• Understanding of the Programmatic Advertising, real-time bidding (RTB), and audience segmentation technologies.

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• 401(k) plan
• Life insurance coverage
• Disability benefits
• Tuition assistance program
• Paid time off (PTO)
• Bonus eligibility