Senior Director, Psychometric Systems

College Board

5d•$120,000 - $175,000•Remote

About The Position

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. We provide our partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of psychometrics and supports College Board’s mission of access and equity in education. Our team of Psychometricians and Research Statisticians collaborates deeply with other departments and divisions including, but not limited to Assessment Design & Development, College Readiness Assessments, Advanced Placement & Instruction, State & District Partnerships, and Technology. Psychometrics is continuing to evolve as an implementation-driven organization, supporting a growing portfolio of products and initiatives. As the scale and complexity of this work increases – with advances in digital assessment, automated scoring, AI-enabled measurement --there is an opportunity to strengthen the operational backbone that enables consistent delivery, cross-product coherence, and future-focused evolution—while preserving deep product expertise and technical leadership. The Senior Director, Psychometrics Operations provides function-wide operational and people leadership to support this evolution. This role establishes prioritization mechanisms, builds a coherent cross-product operating model, and enables scalable implementation and modernization of psychometric practices. The Senior Director partners closely with Executive Directors, who serve as the technical leaders for psychometrics, to ensure work is delivered effectively and sustainably while creating space for forward-looking technical leadership. The scope of this role is intentionally focused on building sustainable operational infrastructure and people leadership capacity, rather than owning day-to-day technical delivery or product-specific decision-making.

Requirements

Experience working closely with psychometric teams or in psychometrics-adjacent environments, with a strong understanding of how psychometric work is designed, implemented, and supported across products; experience may include operations or organizational leadership, but deep familiarity with psychometric practice is preferred over general program management.
10+ years of experience in operations leadership, organizational enablement, or related roles in complex, technical, or analytics-driven environments.
Demonstrated ability to design and implement scalable operating models, processes, and systems that support both effective delivery and long-term capability building.
Experience operating across multiple products or portfolios and navigating competing priorities in matrixed organizations.
A strategic and inclusive leadership style, anchored in strong people leadership: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging.
A proven ability to drive performance and growth: you set high expectations, provide timely and evidence-based feedback, and coach team members to achieve meaningful impact.
Strong communication and stakeholder-management skills, including the ability to partner effectively with deep technical experts while providing operational clarity and alignment.
Ability to travel approximately 10 times per year (typically ~1.5 days per trip), representing roughly 5–10% of overall work time, to College Board offices or on behalf of College Board business.
A passion for expanding educational and career opportunities and mission-driven work
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success
Authorization to work in the United States

Nice To Haves

Expertise in psychometrics-focused operations and leadership, with approximately 10+ years of experience supporting, leading, or enabling psychometric work in complex, implementation-driven environments (e.g., assessment programs, research/statistics teams, analytics organizations).
A strategic and inclusive leadership style, demonstrated through setting clear priorities, building effective team structures, planning for future needs, and fostering a culture of belonging.
A proven ability to drive performance and growth, demonstrated through setting high expectations, delivering real-time, evidence-based feedback, and coaching team members to take smart risks, stretch their skills, and achieve meaningful impact.
Content-specific and technical fluency relevant to psychometrics and analytics environments, including familiarity with psychometric workflows, process design, documentation standards, and the use of program and collaboration tools to manage complex, cross-functional work

Responsibilities

Manage the Natural Language Measurement (NLM) / Automatic Scoring Team (AST) (40%)
Lead Execution & Demand Alignment Across Psychometrics (30%)
Strengthen Cross-Program Coordination & Scalable Practices (20%)
Leadership Operations & Program Support (10%)