Engineering Manager, Data Platform Orchestration

Netflix•Los Gatos, CA

About The Position

The Analytics Platform and Experience (APeX) team at Netflix is responsible for providing orchestration and compute technologies for ETL and accessing data in the Netflix Warehouse. This includes managing the Iceberg table format, metadata, security, and data lifecycle. The team also focuses on the end-to-end development experience for data practitioners, offering scalable, self-serve analytics capabilities. Within APeX, the Orchestration team specifically builds and operates a reliable, cost-efficient, and user-friendly platform for analytics and machine learning workflows. This platform handles scheduling, orchestrating, and executing big data workflows at scale, powered by Maestro, a next-generation, in-house workflow orchestration system. Maestro supports thousands of users and hundreds of thousands of workflows daily. The team is also developing higher-level abstractions, including an ETL framework for incremental data processing and intelligent operations through automated error classification and GenAI-powered remediation.

Requirements

An experienced engineering leader who can drive a team of amazing and geographically distributed engineers to do their best work while building and maintaining strong partnerships with peers and stakeholders.
Ability to dive deep as needed to facilitate technical strategy trade-offs and zoom out to understand the big picture to shape the product.
Experience building and running extremely reliable platform systems supporting high-scale and critical workloads, including running a 24x7 on-call, 99.95+% availability, fast response, and short mean-time-to-restore service.
Bring rigor to decision-making and reduce ambiguity with the right mix of data collection, seeking input, farming for dissent, and making pilot investments to build understanding or confirm direction.
Proven track record helping a team deliver timely results on critical priorities against many demands for their time, and partnering with product and engineering management to influence the right areas for investment.
Experience building and leading software engineering teams with a focus on inclusion and diversity, ensuring that we can attract and retain the best talent from anywhere and that all voices are heard to inform our direction.

Nice To Haves

Experience in Orchestration, Spark, Trino/Presto, Snowflake, BigQuery, RedShift, Druid, LanceDB, and/or Big Data Analytics technologies is not a must, but very desirable.

Responsibilities

Partner to deliver the vision, strategy, and adoption of current and future technologies.
Form trusting cross-functional partnerships to align many engineering teams and ensure our solutions meet their needs, selflessly prioritizing work beyond the scope of your own domain.
Build, scale, and grow a team of outstanding engineers, challenge them to bring their best selves to work every day, and deliver industry-leading results in stability, performance, and efficiency.
Balance smart risks, investment in foundational technical work, paying off tech debt, and incremental improvements to deliver timely results across multiple critical strategies.