Director, Digital Experience Experimentation
About The Position
As Director of Digital Experience Experimentation, you’ll be providing technical leadership for experimentation technology across Sephora's digital ecosystem and defining the strategy for AI-powered and non-deterministic experiences. The work you do will impact beauty, as you evolve experimentation capabilities to meet rapidly growing test demand and ensure reliable, secure, and performant technical standards. You’ll manage a team that’s united in beauty, supported by those who are equally passionate about driving the industry forward through rigorous data, experimentation, and emerging AI capabilities. Sephora has a mature experimentation practice led by product, business, and analytics teams, primarily using Adobe Target, currently. This role adds the technical leadership layer the program needs to scale — owning platform architecture, engineering standards, implementation patterns, governance, and measurement methodologies while partnering closely with the product managers and business teams who drive test strategy, scheduling, and results interpretation. This is a critical leadership role for keeping Sephora at the leading edge of how we measure, optimize, and scale changes to our digital client experiences. As AI-first experience delivery grows, traditional A/B testing assumptions — deterministic variants, static content, conventional sample sizing — no longer hold. The person in this role will define how Sephora tests, measures, and safely rolls out experiences where content is dynamic, personalized, and generated rather than manually authored.
Requirements
- 10+ years of experience in technology, experimentation platforms, digital product engineering, analytics engineering, data science, personalization, ecommerce optimization, or a related field.
- 7+ years of experience leading cross-functional experimentation, personalization, digital optimization, or platform initiatives at scale.
- 7+ years of deep hands-on understanding of digital experimentation methods including A/B testing, multivariate testing, feature rollouts, holdouts, incrementality, and personalization leveraging platforms such as Adobe Target, Optimizely, or similar tools.
- Proven ability to define scalable technical standards, governance models, and reusable implementation patterns for high-scale digital businesses.
- Bachelor’s degree in Computer Science, Engineering, Statistics, Mathematics, Economics, Analytics, Information Systems, or equivalent practical experience required.
Responsibilities
- Own Sephora’s Experimentation Platform and Technical Standards by setting the technical strategy, roadmap, and architecture for site, mobile apps, and digital experience platforms.
- Build the Experimentation Operating Model and Governance by establishing frameworks for prioritizing, launching, monitoring, and scaling digital experiments across technology and business teams.
- Lead People, Vendors, and Cross-Functional Execution by coaching a team of technical experimentation specialists, managing vendor relationships, and influencing senior stakeholders across digital commerce.
- Define the experimentation and evaluation strategy for AI-powered, non-deterministic, and dynamically personalized experiences where traditional A/B testing methods require adaptation.
Benefits
- Medical, dental, and vision coverage
- Disability insurance
- Life insurance
- 401k with 4% match
- FSA and HSA programs
- Student Debt Retirement plan
- PTO
- Flexibility
- Protected leave
- Access to training, development, and tuition reimbursement
- 30% discount on all merchandise/services
- Opportunities for free product or “gratis”
- Flash sale discounts on LVMH brand products
- Free mental health and financial coaching resources with 24/7 access to Modern Health and Financial Finesse
- Volunteer and donation matching
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Director
