Conversion Rate Optimization (CRO) Lead — Remote, $80k-$120k/yr inc

AIOS (YC W20/S21)

9d•$80,000 - $120,000•Remote

About The Position

As the Conversion Rate Optimization (CRO) Lead at AIOS (Bolt Pharmacy), your mission is to streamline the CRO process. You will manage all aspects of the CRO machine, including ideation, QA, project management, and test analysis, ensuring continuous and rapid experimentation. CRO is a key driver of paid efficiency and unit economics, crucial for scaling the company. You will be responsible for the daily execution of experiments across the entire user funnel, encompassing landing pages, the intake flow, and the checkout process. This is a hands-on role requiring daily involvement in running experiments. While the current stack includes Omniconvert, PostHog, and HEX, you should be adaptable to different testing and analytics tools. Your goal is to ensure CRO continuously improves as AIOS scales in the UK and expands into the EU. Success in this role means maintaining a consistent pipeline, a prioritized roadmap, accurate QA, and reliable test analysis. Exceptional performance could lead to future senior roles within the Performance Team. This is a full-time, fully remote position, allowing for asynchronous work within your chosen timezone, with the expectation of sufficient overlap with European and US time zones (midday Pacific Time) when necessary. You will report directly to the Head of CRO, Michael McCann, and collaborate closely with the CRO and Web team, which includes two Growth Engineers and one Growth Designer.

Requirements

Experience: 4+ years of experience running a high volume (>hundreds) of experiments for DTC e-commerce brands in fast-paced, high-transaction-volume environments.
Workstream Management: Experience managing dozens of simultaneous tests, unblocking builds, and maintaining a coherently sequenced and progressing roadmap without becoming overwhelmed.
Hands-on Execution: Proven track record of owning end-to-end testing processes, from ideation and setup to QA and analysis, rather than solely managing agencies or teams.
Funnel Literacy: Understanding of the ad-to-landing-page handoff and the interplay between CRO and paid efficiency metrics (CAC, quality score, LP experience).
Analytical Skills: Strong analytical and CRO mindset, comfortable digging into data, identifying segments and behaviors, and demonstrating a hunger for continuous improvement and upskilling.
Structured Approach: Proficiency in written planning, explicit prioritization, and dependable reporting cadences that allow teammates to easily digest and apply learnings.
Autonomy: Ability to operate with high ownership in a fast-moving environment, measuring success by outcomes and demonstrating pace and self-direction.

Nice To Haves

Statistical sophistication: Deeper fluency in statistics, including significance, power, sequential testing, and methods to prevent false positives.
Research skills: Comfort with both qualitative and quantitative research methods, such as heatmaps, session recordings, surveys, and user testing, to generate hypotheses.
Regulated-industry CRO: Experience experimenting within regulated industries, understanding compliance constraints on testing and messaging while maintaining velocity.
Technical understanding: Basic understanding of website functionality and data, enabling precise communication of ideas to development and design teams and effective QA.
Localization experience: Experience running experimentation across multiple markets, particularly in the UK and EU.

Responsibilities

Test ideation & roadmap: Maintain a full and prioritized pipeline by transforming analytics, session data, research, and paid-performance signals into a consistent stream of high-quality hypotheses, sequenced by expected impact.
Experiment setup: Structure clean experiments with clear hypotheses, primary metrics, sample sizes, and guardrails to ensure tests yield definitive decisions.
QA hygiene: Thoroughly QA all variants across devices and edge cases before launch to prevent broken, off-brand, or non-compliant elements from reaching users and to protect the funnel from regressions.
Analysis & readouts: Analyze results with strong statistical rigor (significance, confidence, segment effects) to determine winners, losers, or inconclusive outcomes, providing clear and trusted readouts.
Program management: Act as the primary owner for keeping all CRO activities running smoothly, coordinating with Growth Engineers and Designers, unblocking builds, managing the pipeline, and ensuring continuous momentum.
Analytics & reporting: Own a clear weekly reporting cadence detailing shipped experiments, outcomes, key learnings, and next steps, ensuring the wider team can easily understand and act on the insights.