CRO Specialist

Comfrt

7d•$80,000 - $100,000•Remote

About The Position

Comfrt is a direct-to-consumer brand focused on mental wellness, inclusivity, and comfort. The CRO Specialist drives execution of Comfrt’s experimentation roadmap by designing and launching end-to-end experiments, analyzing results, and identifying risks that could affect strategy. The role combines technical fluency with analytical depth and requires comfort using testing platforms and defining appropriate measurements. The CRO Specialist reports to the CRO Manager. The specialist executes experiments across web and mobile, coordinates roadmap progress and vendor delivery, develops test ideas from data and UX insights, and leads front-end quality assurance. The role also supports ecommerce dashboards and monitors site health metrics, escalating anomalies and sharing regular testing updates with the CRO Manager.

Requirements

At least 2–3 years of ecommerce CRO experience in an agency, in-house, or direct-to-consumer brand setting.
Experience owning, designing, and launching A/B tests and structuring experiments using testing platforms.
Ability to identify appropriate metrics for different test types and interpret test results.
Comfort reading dashboards, identifying obvious anomalies, and asking clarifying questions about data.
Experience navigating and building tests in a modern CMS or testing tool.
Ability to read HTML, CSS, and JavaScript, communicate clearly with developers, and identify implementation issues.
Project management skills, including maintaining roadmaps, identifying blockers early, and coordinating across teams.
Strong familiarity with the Shopify ecosystem and understanding of vendor offerings and their impact on ecommerce businesses.
Familiarity with workflow tools such as Asana, Jira, and ClickUp.
Proactive, self-directed approach in fast-paced environments, with willingness to learn and grow the ecommerce function.
Ability to identify blockers early, solve problems autonomously, and treat experiences as learning opportunities.

Responsibilities

Build and launch A/B and multivariate tests across web and mobile using testing platforms and the CMS.
Define measurement plans and relevant success metrics for each test hypothesis before launch.
Set up audience targeting and segmentation according to test design requirements.
Monitor tests, check for data issues, and validate progress toward sample-size targets.
Report test results and findings to the CRO Manager, including raw data, outcomes, and action plans.
Maintain the testing roadmap, track progress, and flag delays, blockers, or other risks early.
Ensure tests launch on schedule and meet quality standards; collaborate with design and development to keep implementations on track.
Generate test ideas based on data-team findings, UX insights, and business priorities.
Document test post-mortems, maintain a hypothesis repository, and record learnings from experiments.
Execute experiments in vendor platforms, including PrettyDamnQuick, Algolia, and the Fuego mobile app, and coordinate with vendor teams on status, blockers, and deliverables.
Ensure mobile app testing aligns with web business and retention priorities.
Collaborate with technology, retention, and paid teams on testing ideas across channels and customer lifecycles.
Lead visual QA for front-end implementations, verify features against their briefs, identify bugs and edge cases, and partner with developers to validate implementation quality.
Help maintain and refresh ecommerce reporting dashboards with the data team using Looker Studio.
Monitor daily site-health metrics, including core KPIs, add-to-cart rates, and checkout abandonment; investigate and escalate anomalies or risks.
Provide weekly testing KPI snapshots to the CRO Manager for leadership recaps.