Senior Manager Experimentation, Testing, & Learning

ServiceNow•Santa Clara, CA

22h•$155,400 - $272,000•Remote

About The Position

The Senior Manager, Experimentation, Testing, & Learning owns the quarterly experimentation roadmap and learning agenda that drives measurable improvements in buying group progression. This role runs end-to-end test governance across buying group experience, ensuring tests are designed well, implemented correctly, measured cleanly, and translated into clear scale or stop decisions.

Requirements

7+ years in growth marketing, performance marketing, experimentation, analytics, or marketing operations with ownership of cross-channel testing programs and a track record of turning test results into strategic decisions.
Experimentation Design: A/B, multivariate, holdouts, lift studies, geo experiments and common design pitfalls to avoid
Cross-Channel Testing: paid media (programmatic, search, social), owned channels, site experience, and creative
Measurement Partnership: incrementality design, impact evaluation, and efficiency metric standardization
Agency & Platform Execution: clean test setup, QA, trafficking, and consistent measurement across partners
Reporting & Decision Frameworks: standardized readouts that drive repeatable scaling decisions
Strategic Vision: able to define a learning agenda that connects test-and-learn activity to business outcomes, not just optimization metrics
Cross-Functional Influence: drives alignment and adoption of experimentation standards across Media, Measurement, DX, Integrated Marketing, and agency partners
Decisiveness & Clarity translates ambiguous test results into clear, actionable recommendations for senior stakeholders
Accountability & Rigor holds the bar on test design quality and documentation standards across all partners
Structured Communication: turns complex measurement concepts into digestible readouts that inform strategic decisions

Nice To Haves

Experience tying experimentation to buying group progression or multi-stakeholder B2B journeys
Experience with onsite experimentation tools and landing page optimization programs
Familiarity with media platform experimentation products — conversion lift, brand lift, incrementality testing

Responsibilities

Own and evolve the quarterly experimentation roadmap and learning agenda, aligned to brand, events, and integrated program goals with emphasis on buying group progression.
Manage test intake and prioritization using clear criteria, expected impact, feasibility, time-to-learn, and cross-channel applicability, maintaining balanced coverage across paid, owned, site, and creative.
Define and maintain test design standards: hypotheses, primary and secondary KPIs, success thresholds, guardrails, and decision rules.
Partner with Measurement to define incrementality approaches, holdouts, lift studies, geo tests, platform experiments and standardize efficiency metrics.
Partner with agency and platform teams to ensure clean implementation, consistent exposure rules, and strong QA across channels.
Coordinate with DX on site and landing page tests, including experimentation tooling, tagging, data layer dependencies, and conversion-path measurement.
Partner with creative and agency teams to structure creative tests (message, offer, asset variants) with clear learning objectives and measurement plans.
Standardize how results are reported — readout templates that clearly summarize lift, confidence, segment impacts, tradeoffs, and recommended decisions.
Lead quarterly readouts that drive decisions to scale, stop, iterate, or retest, with documented rationale.
Maintain scaling criteria and update global playbooks when tests show measurable lift and repeatability.