Data Engineer II

The Walt Disney Company • Seattle, WA

1d • Hybrid

About The Position

Disney Entertainment and ESPN Product & Technology is a global organization focused on building and advancing the technological backbone for Disney’s media business. The team combines technology with creativity to create world-class products, enhance storytelling, and drive innovation and scalability. Technologists in this group design and build products and platforms powering media, advertising, and distribution businesses. The Discovery Data team specifically builds systems that provide tailored experiences across streaming products globally, using Machine Learning and Artificial Intelligence for content discovery and seamless browsing. The Core Data team is central to this mission, providing the foundational data layer for Machine Learning models and User Experience APIs to ensure optimal personalized experiences for millions of subscribers worldwide.

Requirements

• Bachelor's degree in Computer Science (or related field), or equivalent work experience
• 3 years of experience working with large scale data workloads, building and curating datasets and developing data pipelines and processing jobs
• Strong programming skills in Python, Java, or comparable object-oriented language
• Experience working with Databricks or equivalent large-scale data processing platforms
• Demonstrated knowledge of operating within a Public Cloud Provider (e.g. AWS, Microsoft Azure, Google Cloud)
• Experience working with source control systems and CI/CD pipelines
• Strong grasp of computer science fundamentals (data structures, algorithms, design patterns, etc.)
• Strong communication skills, both written and verbal

Nice To Haves

• Proficiency working in Databricks to build data pipelines
• Experience with distributed data processing frameworks, such as Apache Spark
• Demonstrated knowledge of messaging technologies (e.g. Kafka, Kinesis, SQS, or other)
• Familiarity with recommendation systems industry architectures and best practices
• Hands-on experience with NoSQL data stores (e.g. DynamoDB, Cassandra, ScyllaDB, or other)
• Hands-on experience using AI and coding assistants to accelerate design and development

Responsibilities

• Identify and build new user and content data features for recommendation systems through collaboration with machine learning engineers
• Enhance existing feature quality through experimentation, analysis and iterative development
• Design, craft and own high quality foundational data sets to produce reliable, meaningful inputs for machine learning models and subscriber experiences
• Source, analyze and validate diverse upstream data sources from upstream partner teams and raw signals using exploratory data analysis
• Build, optimize and maintain large scale data processing jobs, pipelines and workloads
• Improve data quality and reliability through implementing checks, anomaly detection, testing, monitoring and alerting
• Contribute to operational excellence by following observability best practices and participating in an on-call rotation to support critical production data pipelines

Benefits

• A bonus and/or long-term incentive units may be provided as part of the compensation package
• full range of medical, financial, and/or other benefits, dependent on the level and position offered

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level