Sr AB Testing Analyst

Columbia Sportswear Company • Portland, OR

13d

About The Position

Are you passionate about spending time outdoors and empowering others to do so? The Columbia eCommerce team plays a crucial role in improving the consumer experience on our Columbia sites and digital platforms in the US and Canada. From merchandising and marketing to CX/UX and creative, the consumer is at the heart of everything we do. If celebrating the outdoors is your mission, consider joining us today. The Sr. AB Testing Analyst is the team’s statistics-focused expert, implementing the A/B testing program and driving high-impact A/B and personalization testing and optimization. This position ensures rigorous methodology, accurate data validation, and actionable insights that inform data-driven decisions and improve key performance indicators.

Requirements

• Experienced in presenting insights and making persuasive recommendations.
• Strong in analytical, quantitative, and problem-solving skills.
• Detail-oriented with a commitment to accuracy and quality.
• Comfortable working in an Agile, collaborative environment.
• Able to manage multiple priorities and deliverables effectively.
• Bachelor’s degree in statistics, math, engineering, or related field preferred.
• 5+ years of eCommerce analytics experience.
• 3+ years designing and analyzing A/B tests.
• Advanced coding skills in Python, R, and SQL; familiarity with HTML, CSS, JavaScript.
• Experience with optimization tools (Adobe Target, Optimizely, Monetate).
• Experience with web analytics tools (Adobe Analytics, Google Analytics).
• Knowledge of testing approaches (A/B, MVT, Personalization).
• Familiarity with project management tools (Jira, Confluence).

Responsibilities

• Validate accuracy of data and QA site tagging needed for tests.
• Apply frequentist and Bayesian statistical methods to measure performance and interpret results.
• Calculate test runtime requirements based on traffic, KPI rates, and expected lift.
• Follow scientific rigor to objectively report results and collaborate with subject matter experts to provide relevant recommendations.
• Partner directly with business owners and the eCommerce team to plan, execute, and analyze A/B tests.
• Collaborate with stakeholders to validate hypotheses and strategically plan site opportunities and future test plans.
• Drive the testing lifecycle process from ideation to planning, requirements gathering, execution, analysis, and results communication.
• Prioritize testing calendar to make the best use of available traffic and resources.
• Develop and document testing processes and policies to increase quality and rigor.

Benefits

• Benefits that can protect your family’s financial future and help you save money through our 401k plan plus a generous company match.
• Columbia offers medical, dental, vision, life Insurance, disability, flexible spending accounts, health savings account, and an assortment of voluntary benefit offerings (accident, critical illness, hospital indemnity, and legal services).
• In addition, Columbia offers EAP + which is free and confidential 24/7/365 counseling services.
• We have extensive wellness benefits, employee discounts and a generous time off program available.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees