Senior Experimentation Specialist

Alaska Airlines-posted 15 days ago

Full-time • Mid Level

Onsite • Seatac, WA

5,001-10,000 employees

Resume

Match Score

Upload and Match ResumeTrack Jobs with Teal

The Senior Experimentation Specialist is a subject matter expert in digital experiments at Alaska Air Group (AAG). As an individual contributor, this role exercises considerable judgment to make decisions in the design and execution of digital experiments and makes recommendations to improve Alaska's merchandising strategy and product design.

Serves as a subject matter expert in experimentation, guiding teams on statistical rigor, test design, and measurement strategy across digital and commercial products.
Employs deep knowledge of all Alaska revenue products and merchandising strategies to make recommendations to improve Alaska's product merchandising and design.
Builds experiment health monitoring (sample ratio mismatch, peeking detection, high variance flags) to ensure reliable and trustworthy results.
Conducts deep-dive analyses on user behavior, long-term impact, and key performance indicator (KPI) interactions to uncover insights beyond simple test lifts.
Researches and applies advanced experimentation methodology (CUPED, variance reduction, sequential testing, causal inference techniques) to improve test sensitivity, velocity, and data quality.
Utilizes strong technological skills, including use of testing tools (Optimizely), computer languages (python), querying tools (SQL), data manipulation tools (Databricks, Excel) and presentation tools (Tableau, PowerPoint) to conduct experiments, research and analysis.
Partners closely with product, engineering, and commercial stakeholders to instrument data and data tagging properly, ensuring alignment between business metrics and statistical measurement.

4 years of experience in AB testing, computer science, analytics, quantitative sciences or related area.
Bachelor's degree with a focus in UX design, psychology, mathematics, statistics or related discipline, or an additional 2 years of relevant training/experience in lieu of this degree.
Advanced proficiency with Microsoft Office applications (e.g., Word, Excel, PowerPoint, and Outlook) and databases and large datasets (Databricks, SQL, python).
High school diploma or equivalent.
Minimum age of 18.
Must be authorized to work in the U.S.

Experience in the airline industry.
Intermediate skills in presenting data-driven strategic insights, including use of visualization tools (Tableau).
Advanced working knowledge of experimentation design, implementation, and tools (AB, MVT, Multi-Armed Bandit; CSS, HTML; Optimizely).
Ability to establish cross-functional, collaborative relationships with other teams, valuing diversity and inclusivity.
Detail oriented and highly organized, with the ability to multi-task in a fast-paced, dynamic environment.
Data-driven mindset and a proven history of continuous self-development.
Proven track record of applying insights to business strategy.
Excellent communication skills (both written and verbal) and strong interpersonal skills with the ability to drive outcomes in the best interest of the company.

Free stand-by travel privileges on Alaska Airlines, Hawaiian Airlines & Horizon Air
Comprehensive well-being programs including medical, dental and vision benefits
Generous 401k match program
Quarterly and annual bonus plans
Generous holiday and paid time off

Track Jobs with Teal

Job Search Resources

•

Resume Builder

•

Resume Examples

•

Cover Letter Examples

Senior Experimentation Specialist

Job Search Resources

Tools

Career Hubs

Guides

Company