Manager, Experimentation & Advanced Analytics

Universal Orlando•Orlando, FL

About The Position

The Manager, Experimentation and Advanced Analytics conducts advanced analysis of digital customer behavior and business performance to identify and evaluate opportunities that improve revenue, conversion, engagement, and the guest experience across Universal Destinations & Experiences. This role supports optimization and experimentation initiatives across Universal Orlando Resort (UOR), Universal Studios Hollywood (USH), Universal Studios Japan (USJ), and new ventures, requiring an understanding of distinct business objectives, guest behaviors, market dynamics, operating models, and analytical nuances. This role serves as a technical and analytical subject matter expert for experimentation and optimization, applying advanced statistical methods and leveraging SQL, Adobe Analytics, Customer Journey Analytics (CJA), Adobe Experience Platform (AEP), Real-Time CDP (RTCDP), Snowflake, Databricks, Tableau, and Power BI to translate complex test results into actionable recommendations for global and destination-level stakeholders.

Requirements

Advanced proficiency in SQL, including the ability to query, join, transform, and analyze large and complex datasets.
Advanced proficiency with Adobe Analytics and Customer Journey Analytics (CJA), including segmentation, calculated metrics, customer journey analysis, conversion analysis, and digital performance measurement.
Experience leveraging Adobe Experience Platform (AEP) and Real-Time CDP (RTCDP) to develop, size, and analyze customer audiences and support targeting, experimentation, and optimization use cases.
Strong experience using Snowflake and Databricks to access, prepare, manipulate, and analyze enterprise-scale datasets.
Advanced proficiency with Tableau and/or Power BI, with demonstrated ability to develop scalable reporting solutions and communicate complex analytical findings to technical and non-technical audiences.
Strong knowledge of experimental design, A/B and multivariate testing, statistical significance, confidence intervals, test/control methodologies, and performance measurement.
Demonstrated experience analyzing complex tests or experiments and translating results into actionable business recommendations.
Ability to apply common analytical methodologies across multiple businesses while recognizing and adapting to differences in market conditions, customer behavior, operating models, data structures, and strategic priorities.
Strong critical thinking and problem-solving skills with the ability to work through complex and ambiguous analytical problems independently.
Demonstrated ability to build effective relationships and work across geographically dispersed, cross-functional teams.
Bachelor's degree in Statistics, Data Science, Analytics, Economics, Econometrics, Mathematics, Computer Science, Business Analytics, or a related quantitative field required.
5+ years of hands-on experience in advanced analytics, experimentation, optimization, data science, digital analytics, or a related quantitative discipline; or an equivalent combination of education and experience.

Nice To Haves

Master's degree in a quantitative discipline preferred.
Experience conducting complex experimentation and test analysis, including pricing, marketing, email, digital experience, or similar testing, strongly preferred.
Experience supporting multiple business units, markets, destinations, or geographies and adapting analytical approaches to differing business needs is preferred.

Responsibilities

Lead the analytical measurement and evaluation of optimization initiatives across UOR, USH, USJ, and new ventures, including pricing tests, email tests, digital experience tests, marketing tests, and other controlled experiments.
Quantify the potential financial impact of optimization opportunities across destinations, develop analytical approaches to estimate expected value, and prioritize the experimentation backlog based on revenue potential, business impact, feasibility, and strategic priorities.
Apply statistical and experimental design methodologies to evaluate performance, incremental impact, statistical significance, and business value, accounting for differences in customer behavior, market conditions, seasonality, product structures, and business objectives.
Develop measurement approaches that provide consistency across destinations while allowing for local business requirements and market-specific nuances; provide recommendations regarding implementation, continued testing, or additional optimization.
Use advanced SQL and enterprise data platforms, including Snowflake and Databricks, to extract, integrate, manipulate, validate, and analyze large and complex datasets across multiple destinations and business areas.
Integrate digital behavioral data from Adobe Analytics with transactional, customer, pricing, marketing, and other enterprise data sources to develop comprehensive analyses of customer behavior and business performance.
Navigate variations in data structures, taxonomies, business rules, tracking implementations, and reporting practices across destinations while maintaining analytical consistency and rigor.
Develop reusable datasets, queries, methodologies, and processes that improve the scalability and efficiency of global optimization analysis and troubleshoot data or performance anomalies.
Apply advanced Adobe Analytics and Customer Journey Analytics (CJA) capabilities to analyze cross-channel customer behavior, journeys, segmentation, conversion, engagement, and marketing performance across multiple destinations.
Use AEP and RTCDP to develop and size actionable audience segments, assess addressable opportunity, and inform targeting experimentation, and optimization priorities across UOR, USH, USJ, and new ventures.
Develop and maintain Tableau and Power BI dashboards, analytical tools, and data visualizations that provide visibility into test performance, optimization opportunities, customer behavior, and key business outcomes for global and destination-level stakeholders.
Establish and monitor key performance metrics and build measurement approaches that enable comparison and knowledge-sharing across destinations while appropriately accounting for local market and business differences.
Transform complex analytical outputs into clear visualizations and compelling data stories for technical and non-technical audiences.
Serve as a subject matter expert in experimentation, optimization analytics, digital measurement, and test interpretation across UDX.
Partner with global and destination-level Marketing, Digital, Pricing/Revenue, Product, Technology, and other stakeholders to identify opportunities and establish analytical approaches.
Develop an understanding of the unique strategic priorities, guest segments, commercial models, market dynamics, and operating environments of UOR, USH, USJ, and new ventures, adapting recommendations accordingly.
Present findings and recommendations to stakeholders and leadership and facilitate the sharing of testing methodologies, learnings, and optimization best practices across destinations.
Understand and actively participate in Environmental, Health & Safety responsibilities by following established UDX policy, procedures, training, and team member involvement activities.
Perform other duties as assigned.