Senior Web Experimentation Manager

Tailscale

2d • $114,000 - $145,000 • Remote

About The Position

We're looking for a Senior Web Experimentation Manager to own the experimentation program across Tailscale's highest-traffic website pages, including the homepage, pricing, use-case pages, and paid landing pages. You'll set the roadmap, the test design standards, and the decision rules every experiment runs on, and you'll design and ship the highest-stakes tests yourself. You'll work closely with web strategy, web development, design, product marketing, and analytics partners, and you'll coach the people running tests alongside you. This role is for someone who has run an experimentation program, and not only experiments. You know when a test is the right tool and when a change is better shipped without one. You can hold a decision rule when a result is inconvenient, and you treat a flat result as information. Success means a program the rest of the company trusts, results that hold up to scrutiny, and learnings that change what we build next.

Requirements

• 6–9 years of experience in conversion optimization, web experimentation, growth marketing, or a related field, including ownership of an experimentation program across multiple pages or products
• Deep experience with a testing platform such as Optimizely, VWO, or a comparable tool, including program-level setup and governance
• Strong command of experiment statistics, including power and sample size, minimum detectable effect, false positive control, guardrail metrics, sample ratio mismatch, and the risks of peeking and multiple comparisons
• The ability to evaluate a test's design and validity, and to explain plainly why a result should or shouldn't be trusted
• Comfort with HTML, CSS, and JavaScript to build and debug client-side variations yourself
• Working proficiency in SQL and an analytics tool such as GA4, enough to validate results independently of the testing platform
• Sound judgment about when an experiment is the right tool, and when a change is low-risk and reversible enough to ship without one
• Clear writing and communication, with the ability to present results and tradeoffs to senior stakeholders
• Experience coaching or mentoring others on experimentation, formally or informally
• Comfort working in a remote-first, async environment

Nice To Haves

• Experience experimenting on pricing pages, or on pages that route visitors between self-serve and sales-assisted paths
• Experience with B2B SaaS, developer tools, infrastructure, or cybersecurity products
• Experience with server-side or feature-flag testing, or with Bayesian or sequential testing methods
• Experience moving an experimentation program from one testing platform to another
• Familiarity with accessibility and web performance considerations in test builds
• Experience building an experiment library that other teams use

Responsibilities

• Own the experimentation roadmap, from taking in ideas across the team to prioritizing them against traffic, expected impact, and cost.
• Set and maintain the standards every test runs on, including sizing, statistical power, minimum detectable effect, guardrail metrics, and the rules for shipping, iterating, or stopping a test.
• Review test designs before launch and results before they're shared, so every number we report is one we can stand behind.
• Design, build, and run the most consequential experiments yourself, particularly on pricing and the homepage.
• Own the health of our testing platform and measurement with web development and analytics, so tracking works and results reconcile with our analytics data.
• Maintain the experiment record as the source of truth for what our website has learned, and turn accumulated results into recommendations for web strategy.
• Report program results to marketing leadership: what we learned, what shipped, and what we're testing next.
• Coach contributors across web, design, and marketing on hypothesis quality, test design, and reading results correctly.

Benefits

• Competitive total compensation package including base salary, equity incentive plan, and variable commission (for quota-based roles).
• Comprehensive group benefits with no waiting period for health, vision, dental, and more for you and your family.
• Remote-first company with flexibility in work location.
• Employer-funded retirement contributions with a dollar-for-dollar match up to 0.75% of eligible compensation.
• Support for personal and professional development with $1500 USD annually for professional development, mentorship, coaching, and internal promotion opportunities.
• Flexible, paid time off program.
• Build-your-own home office setup with a company-owned laptop, monthly home internet reimbursement, and $500 USD for customization.
• Paid parental leave program (20 weeks for birthing parents, 16 weeks for non-birthing parents).

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed