Director, Media Experimentation & Engagement

NBCUniversal•New York, NY

9d•Hybrid

About The Position

The Director, Media Experimentation & Engagement leads NBCU’s incrementality and engagement measurement program for Performance and Device media. Experimentation is the causal calibration source for Growth Media Analytics’ measurement triangle: the function that keeps Marketing Mix Modeling (MMM) and Multi-Touch Attribution (MTA) decision-grade. You own the learning agenda, set the standard for rigor, and translate test results into clear budget guidance leaders can act on with speed and confidence. You define how NBCU measures media’s effect on subscriber value and engagement, a critical causal measurement practice for the business. You manage a team to high-quality execution and train the next set of analytic leaders, and you are the face of Growth Media Analytics to Performance Media, Device Media, Growth Strategy, and Decision Sciences leadership on experimentation methodology.

Requirements

8+ years of relevant experience in media measurement and analytics, including experience at measurement vendors or agencies, and including direct people management and a track record of building and developing teams
5+ years expertise in experimentation design and causal inference for media (structured testing, geo experiments, difference-in-differences, platform holdouts), with the ability to evaluate vendor assumptions and methods.
Strong foundation across the measurement triangle of MMM, MTA, and experimentation, with proven ability to reconcile and calibrate across them and translate results into business decisions.
Fluent in SQL and Excel, and proficient in at least one of R or Python for data analysis.

Nice To Haves

Demonstrated experience presenting insights to executive audiences, with ability to create process/governance and ability to answer difficult questions in high pressure situations.
2+ years of experience partnering with (or working at) incrementality measurement vendors (e.g., Haus, Measured, or similar) and managing media, agency, and vendor relationships.
Platform experience across Google, Meta, and TikTok incrementality, and at least one CTV or Device environment (e.g., Roku, Samsung, Vizio).
Working knowledge of clean room environments, with a clear point of view on where they produce decision-grade evidence and where they do not.
Demonstrated ability to measure and optimize multiple KPIs, including acquisition, engagement, and performance outcomes.
Experience leveraging, or strong interest in adopting, agentic AI and automated analytics workflows to scale experimentation and decisioning.
Excellent communication skills and executive presence, with the ability to influence in a highly matrixed environment.
Strong interest in the media industry, specifically television and streaming.
Strong sense of accountability, curiosity, and an innovative mindset, with the ability to thrive in a fast-paced, evolving environment.

Responsibilities

Own and scale the experimentation roadmap. Grow structured testing from roughly 15 to 75 panels per year while raising rigor on budget-grade decisions.
Define the learning agenda, decision questions, hypotheses, success metrics, guardrails, and power thresholds, and approve or reject vendor designs against those standards.
Define and lead engagement measurement. Build NBCU’s forward approach to measuring media’s effect on subscriber engagement and retention, in partnership with Growth Strategy and Decision Sciences. This includes variance reduction techniques for low-signal continuous outcomes, and the translation from measured lift to revenue and retention value.
Own always-on holdouts. Lead holdout design and execution across Performance and Device media, including persistent engagement holdouts.
Collaborate with Media Partners. Direct how NBCU uses conversion-lift (CLS) programs and clean room environments (Meta Advanced Analytics, Google ADH, Amazon AMC) for exposure mapping and lift measurement and set the standard for what partners can and cannot answer.
Own measurement calibration. Serve as the source of truth for calibrating MMM and MTA, keeping media measurement consistent and decision-grade across the portfolio.
Lead experimentation vendor relationships. Manage relationships across incrementality vendors, including new vendor onboarding, data transfer, validating methodology and result, and ensuring critical deliverables are shared to the business.
Represent the team at the executive level. Own measurement-methodology relationships with Performance Media and Device Media leadership, Growth Strategy, Finance, and Decision Sciences. Challenge entrenched measurement beliefs and drive adoption of decision-grade testing.
Build and develop the pod. Directly manage and develop a Manager and an Analyst, and uplevel cross-functional partner teams on test design, statistical power, and common pitfalls.
Drive AI-enabled scale. Use agentic AI and automated analytics workflows to expand testing throughput, insight generation, and decisioning.