Data Engineer II, Ads Product & Tech

Spotify•New York, NY

6d•Remote

About The Position

Our mission on the Advertising Product & Technology team is to build a next generation advertising platform that aligns with our unique value proposition for audio and video. We work to scale the user experience for hundreds of millions of fans and hundreds of thousands of advertisers. This scale brings unique challenges as well as tremendous opportunities for our artists and creators. The ads reporting team is dedicated to creating scalable, reliable data and backend systems that power our advertising ecosystem. Our mission is to enable seamless delivery of personalized, impactful ads while maintaining an exceptional user experience. As part of our team, you will play a key role in shaping and realizing our vision to enhance the advertising experience for our clients and establish Spotify as a market leader in advertising. We are seeking engineers who are passionate about designing, developing, and maintaining robust and scalable systems. You will work closely with cross-functional teams to build data services and APIs that support our advertising platform, enabling innovative features and analytics. Positioned at the heart of our backend operations, you will assist product teams in driving high performance, reliability, and scalability across our systems. Our team culture emphasizes creative problem-solving, rapid iteration, execution, and collaboration.

Requirements

Experience in data engineering with high-volume, heterogeneous data, ideally within distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS, or Azure
Familiarity with data processing frameworks like Scio, GCP Dataflow, AWS EMR, and Apache Beam
Familiarity with API design, microservice architecture, and frameworks like Spring Boot or gRPC.
Programming skills in Java or Scala, and for analytics and data extraction (SQL, Python, Pandas, R)
Commitment to agile software processes, data-driven development, reliability, and responsible experimentation
Hands-on experience with orchestration tools like Airflow or similar
Experience with database systems, both relational (e.g., PostgreSQL, MySQL) and non-relational (e.g., Cassandra, DynamoDB).
Excellent problem-solving and communication skills

Responsibilities

Maintain and enhance Spotifyâs reporting pipelines, ensuring they remain business-critical
Build large-scale batch and real-time data pipelines to efficiently collect, process, and store reporting-related data
Make enhancements to data models and ETL code to improve pipeline efficiency and data quality
Design, develop, and maintain high-performance backend services and APIs to power Spotifyâs advertising platform
Work closely with stakeholders to understand and translate business requirements into technical solutions
Write scalable, testable, maintainable, and high-quality code
Collaborate with engineers, product managers, and other stakeholders, embracing learning and leadership opportunities daily
Monitor daily execution, diagnose issues, and ensure SLAs are met by maintaining and fixing business-critical pipelines