Data Engineer II, Prime Video Advertising

Amazon • Seattle, WA

4d • $132,100 - $178,800 • Onsite

About The Position

Prime Video is a leading entertainment platform offering a wide range of content across various devices. The Prime Video Advertising (PVA) Data Engineering team is seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. This role involves leveraging AWS technologies and internal Amazon tools for data ingestion, transformation, and quality assurance. The engineer will architect big data solutions, automate infrastructure using CI/CD, optimize data models, and work with diverse technologies like Python, EMR, Spark, Iceberg, and AWS data services (Glue, Athena, Redshift). The position also emphasizes data governance, compliance, and collaboration with various teams including Data Scientists, BIEs, SDEs, and PMs to deliver data-driven insights and self-service data products. The ideal candidate is customer-obsessed, passionate about advertising, and capable of leading complex projects.

Requirements

• Bachelor's degree
• 3+ years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience with SQL
• Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
• Knowledge of distributed systems as it pertains to data storage and computing
• Knowledge of batch and streaming data architectures like Kafka, Kinesis, Flink, Storm, Beam
• Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
• Experience with Apache Spark / Elastic Map Reduce

Nice To Haves

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
• Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
• Experience programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Experience that includes strong analytical skills, attention to detail, and effective communication abilities, or experience in technical support

Responsibilities

• Design and implement scalable, fault-tolerant data pipelines using AWS technologies and internal Amazon tools to extract, transform, and load data from multiple sources.
• Collaborate cross-functionally with BIEs, Data Scientists, PMs, and SDEs to understand data requirements and deliver customized data solutions.
• Automate infrastructure deployment with CI/CD pipelines and ensure streamlined processes for deployment and maintenance.
• Ensure data quality through robust validation, cleansing, and deduplication techniques.
• Implement data governance standards, including access control, encryption, data retention, deletion policies, and audit mechanisms to ensure compliance and security.
• Continuously improve and optimize data pipelines and infrastructure, staying up to date with emerging technologies and implementing automation and monitoring tools.
• Build a scalable and reliable data platform supporting analytics and experimentation for intuitive, self-service data products.
• Write high quality code and build scalable applications that interface with critical services and APIs to extract and process unstructured data
• Work with a range of data technologies, including Python, EMR, Spark, Iceberg, Airflow, and many AWS data services like Glue, Athena, Redshift to create end-to-end pipelines that consolidate data from disparate systems.

Benefits

• sign-on payments
• restricted stock units (RSUs)
• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level