Senior Analyst, Experimentation

David Yurman•New York, NY

2d•Hybrid

About The Position

We’re looking for a hands-on Senior Analyst to own experimentation strategy and execution across Email, Paid Media, CRM lifecycle, and E-commerce. This role is responsible for designing rigorous tests, building measurement frameworks, and translating results into clear decisions that improve acquisition, conversion, retention, and customer value. You will partner closely with CRM, Performance Marketing, Technology, E-commerce, Product and UX, and Data Engineering to ensure tests are properly instrumented, statistically sound, and operationally feasible. You will also make sure learnings turn into changes in ongoing programs.

Requirements

4 to 7+ years in analytics, experimentation, growth, or marketing measurement. Luxury retail and e-commerce preferred.
Strong knowledge of experimental design and causal inference fundamentals, including A/B testing, holdouts, power, bias, and confounders.
Advanced SQL skills in Snowflake, BigQuery, Redshift, or similar. Comfortable working with behavioral and transaction datasets.
Experience measuring marketing and lifecycle programs, including Email and paid media, with incrementality thinking.
Ability to communicate results clearly to mixed audiences and drive decisions.
Comfortable owning projects end-to-end in a fast-moving stakeholder environment.

Nice To Haves

Experience with onsite testing platforms such as Optimizely, Adobe Target, AB Tasty, or Dynamic Yield.
Familiarity with CDPs and lifecycle tools such as Salesforce Marketing Cloud
Understanding of MTA and MMM concepts, and how to reconcile them with experimentation.
Structured thinker who turns messy questions into testable hypotheses and clean measurement plans.
Practical statistician who is rigorous without overengineering.
Strong operator who can manage timelines, dependencies, and QA details.
Business-oriented communicator who ties results to profit, growth, and customer value.

Responsibilities

Own end-to-end experimentation from hypothesis to design, launch, QA, analysis, readout, recommendation, and follow-through.
Build and maintain an experimentation intake and prioritization process, including impact vs effort, confidence, and dependencies.
Define best practices for sample sizing, power, holdouts, incrementality, multivariate testing, and test duration standards.
Plan and evaluate tests across lifecycle programs, including triggers, journeys, segmentation, personalization, creative, frequency, and cadence.
Design holdout strategies to measure incremental impact with appropriate risk
Partner with Performance Marketing to run incrementality tests such as geo suppression, conversion lift tests, and holdouts.
Translate paid media tests into business impact tied to CAC, LTV, contribution margin, and downstream retention.
Support onsite and UX testing for merchandising, Homepage, PDP, and PLP experiences, checkout, promotions, and personalization.
Ensure proper event tracking, attribution alignment, and KPI definition, including conversion, AOV, revenue per visit, and margin.
Create standardized test readouts that are easy for non-technical stakeholders to act on.
Build dashboards and recurring summaries of the experimentation roadmap, outcomes, and learnings.
Maintain a test knowledge base so learnings compound over time.