Director, Analytics & Business Intelligence, Digital Product Operations

College Board • New York, NY

1d • $88,000 - $145,000 • Remote

About The Position

The Digital Product division is driving the evolution of College Board’s digital assessment experience. The Digital Product Operations team exists to bring clarity, structure, and measurable outcomes to how College Board’s Digital Product organization plans, delivers, and improves. As Director, Analytics & Business Intelligence, you are the measurement infrastructure behind how Digital Product Operations understands and improves its impact. You build the dashboards, define the metrics, and create the coaching conditions that let product teams and the ProdOps function itself operate on evidence rather than instinct. You are comfortable building in a still-forming space, defining what "healthy" and "adopted" look like before anyone else has, and you don't stop at delivering a dashboard: you take a position on what the data means and own driving the change that follows. In this role, you own the evidence layer that tells Digital Product whether it is improving, not just whether it is busy. Your work spans three domains at once: the health of 15+ product teams' planning and delivery practices, tracked through measures like roadmap completeness and Productboard field discipline; how well those teams are adopting ProdOps-driven ways of working; and whether the ProdOps function’s own change management efforts are gaining traction or falling short. You make the call on what the data means and what should happen next, then act on it, from diagnosing why an initiative is underperforming to designing and driving the intervention. You keep the Senior Director informed as a thought partner in that process, not a gatekeeper for it. What you build doesn’t wait to become useful until it reaches the Senior Director. Your dashboards, frameworks, and coaching directly change how product teams plan, prioritize, and improve.

Requirements

• 5+ years of experience in product analytics, business intelligence, or data analysis within a digital product or technology organization
• Experience measuring and driving organizational change: you understand the difference between awareness and behavior change, track both, and take ownership of designing and following through on the intervention when adoption stalls
• Comfort operating with ambiguity, defining what to measure and how for a function still establishing its own ways of working
• Demonstrated experience building dashboards and metrics frameworks that teams actually use, not just technically sound, but genuinely adopted and acted on
• Strong understanding of product management practices: you know what roadmap maturity, backlog health, and planning consistency look like in practice, and can design metrics that reflect them accurately
• Strong data governance instincts: you define metrics precisely, document them clearly, and prevent measurement drift over time
• Familiarity with Productboard, Jira, and Confluence as data sources: you know how to extract meaningful signals from product management tooling
• Comfort with SQL and APIs to extract and validate your own data, even if you're not a technical builder yourself
• Strong coaching and communication skills: you can translate data into clear, actionable guidance for non-technical audiences without losing accuracy
• A passion for expanding educational and career opportunities and mission-driven work
• Authorization to work in the United States for any employer
• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort learning and applying new digital tools independently and proactively.
• Clear and concise communication skills, written and verbal
• A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input
• A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking
• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success

Nice To Haves

• Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).

Responsibilities

• Define and build product metrics dashboards tracking roadmap maturity, Productboard field completeness, and roadmap change patterns across all 15+ Digital Product teams
• Partner with Product leaders and PM/POs to define what “healthy” looks like for each metric, establishing baselines and targets that reflect meaningful improvement, not just activity
• Design dashboards that are self-serve and easy to interpret, so product teams can understand their own health data without requiring ProdOps to translate it for them
• Prepare executive-ready dashboards with minimal oversight from the Senior Director
• Identify gaps in available data and partner with the Planning & Tooling Governance Director to ensure tooling standards support the metrics the function needs to track
• Build and maintain a measurement framework that tracks how effectively the product group is adopting ProdOps-driven ways of working, including new planning practices, tooling standards, and process changes
• Define adoption metrics for each major ProdOps initiative before it launches, establishing what “adopted” looks like and how it will be measured from day one
• Take a documented position on what the adoption data means, not just what it shows: diagnose whether gaps in adoption stem from awareness, capability, process design, or resistance, then bring a recommended course of action to the relevant stakeholders, partner with the relevant director to design the response, and own the follow-through to confirm whether the intervention worked
• Track change management signals across the product group: awareness rates, behavior change indicators, and the difference between leading and lagging adoption signals
• Own ongoing maintenance of all dashboards across product and ProdOps metrics, ensuring data is current, accurate, and trustworthy at all times
• Establish governance standards for metric definitions, ensuring consistent interpretation across teams and preventing measurement drift as the organization evolves
• Conduct regular audits of data quality; identify and address gaps, inconsistencies, or stale data before they surface in leadership reviews or team conversations
• Partner with the Planning & Tooling Governance Director to ensure metric definitions align with tooling standards and that field governance decisions support accurate measurement
• Document all metric definitions, calculation methods, and data sources in the ProdOps Info Hub so the measurement framework is transparent and maintainable
• Coach PM/POs on how to read and act on their roadmap health dashboards, translating data signals into product decisions and planning adjustments they can make independently
• Coach the ProdOps team on how to interpret function effectiveness metrics, helping the team understand what the data is telling them and where to focus improvement efforts
• Design coaching approaches that build genuine data literacy, not just tool familiarity, so teams develop the capability to operate independently rather than depending on ProdOps for interpretation
• Identify patterns in how teams are misreading or ignoring their metrics; surface these patterns to the Senior Director and the relevant director as input for targeted interventions

Benefits

• Meaningful career
• Supportive team
• Comprehensive package designed to help you thrive
• Fair and competitive compensation, grounded in your qualifications, experience, impact, and the market.
• Open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process.

What This Job Offers

• Job Type: Full-time
• Career Level: Director
• Education Level: No Education Listed