Executive Director, Advanced Placement, Curriculum and Assessment, Reading and Scoring

The College Board • New York, NY

3d • $144,000 - $215,000 • Remote

About The Position

As Executive Director, Advanced Placement, Curriculum & Assessment, Reading and Scoring, you will lead the strategy, systems, and professional learning infrastructure that power the AP Reading—the foundation of scoring excellence and validity across 40+ AP subjects. You will serve as the operational and strategic leader for the planning, training, and systems that enable the 18,000+ AP Readers, 40+ Chief Readers, and 80+ internal Course Experts in AP Curriculum & Assessment to execute scoring with fidelity, accuracy, and consistency. This includes leadership over Reader training and readiness, the development and maintenance of scoring guidelines and generic rubrics, the annual grade- and standard-setting processes, and the Reading publications library, as well as ongoing innovation to advance AP scoring quality and efficiency. Each year, the systems and teams you lead will enable more than 18,000 faculty and AP teachers to accurately score over 20 million student responses across 40+ AP subjects and multiple exam versions. Your leadership will ensure that every AP Exam score reflects fairness, validity, and reliability—empowering students, teachers, and institutions to trust in the rigor and accuracy of AP assessment. You will collaborate closely with the AP Curriculum & Assessment Leadership Team, within which you will sit, as well as AP Assessment Production, AP Delivery, and AP Psychometrics to ensure the reliability, validity, and fairness of scoring processes and outputs. You will also champion cross-functional alignment, ensuring that all Reading, scoring, and standard-setting activities are planned, executed, and communicated with clarity and excellence. You will directly lead three senior staff members: Senior Director, AP Reader Training Senior Director, Reading Publications and Quality Assurance Senior Project Manager, Reading, Scoring, and Coordination

Requirements

• You have 10+ years of experience leading high-impact programs with expertise in large-scale assessment operations, scoring, or training systems within complex organizations, ideally in education, nonprofit, or mission-driven environments
• Deep understanding of assessment design, scoring quality, rubric development, and learning systems.
• Proven ability to apply emerging technologies—including generative AI—to improve scoring and training workflows.
• A strategic and inclusive leadership style: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging.
• A systems-thinking mindset: you thrive in complexity and create clarity through structure, communication, and data-driven decision-making.
• Ability to execute work as both a leader and collaborator across a variety of different internal teams using exceptional communication skills to inspire collaboration.
• A master's degree in a relevant field is required
• Willingness to travel approximately 6 times per year, including 2-4 weeks from late May to mid-June for the on-site AP Readings.
• A passion for expanding educational and career opportunities and mission-driven work
• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively.
• Clear and concise communication skills, written and verbal
• A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
• A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.
• Authorization to work in the United States

Nice To Haves

• an advanced degree is strongly preferred.

Responsibilities

• Drive AP Reader Training and Course Expert Readiness (25%)
• Lead the strategy and execution of training programs that prepare 18,000+ AP Readers and scoring leaders annually to score 20 million+ student responses across 40+ AP subjects.
• Advance training and readiness of 80+ internal AP Course Experts, ensuring all are prepared to facilitate Pre-Reading Prep, Pre-Reading, and Reading activities across all AP Exams.
• Develop and deliver the annual AP Reader learning courses, training modules, user guides, and job aids, ensuring readiness by mid-May each year.
• Lead the AP Internal Training Series, ensuring C&A staff receive end-to-end training on Pre-Reading planning, sample selection, annotation, digital scoring tools, and post-administration publications.
• Partner with AP Assessment Leadership and AP Delivery to ensure training systems, LMS environments, and scoring applications operate seamlessly and meet needs to train Readers and execute all scoring at the AP Reading.
• Integrate learning science, accessibility, and AI-driven design tools to improve training quality, efficiency, and consistency.
• Establish systems to measure Reader confidence and scoring consistency, achieving a goal of 90% Reader agreement that scoring materials enable accurate and consistent scoring.
• Guide the annual selection process of the new cohort of Chief Reader Designates in partnership with AP Delivery.
• Develop and Produce Scoring Assets (20%)
• Lead the annual development and review of 650+ scoring guidelines across 40+ AP subjects, ensuring alignment with course frameworks, psychometric standards, and instructional validity.
• Lead the maintenance and evolution of AP's library of generic rubrics to ensure consistent, transparent application across all subjects and exam formats.
• Direct the development of all Reading planning workbooks (five-part Smartsheet suite) used to identify sample-selection requirements and scoring leadership needs for multiple forms (4-5) across 38 courses.
• Lead creation of post-administration publication templates and assets, including Chief Reader Reports, Free-Response Questions, scoring commentaries, Summer Institute workshop packets, and AP Central materials for multiple forms across all subjects.
• Partner with AP Assessment to maintain and provision gold-source documentation for scoring systems, including dimension names, IDs, score scales, and form data.
• Partner with AP Publications and AP Professional Learning teams to ensure all scoring and publication materials meet accuracy, accessibility, and instructional value standards.
• Provide oversight and escalation for all test-security processes related to Exam and Reading assets, ensuring management of timely responses to flagged or exposed content as well as student work flagged as plagiarized or compromised, in alignment with CB Test Security standards and processes.
• Drive Innovation, Systems Integration, and Continuous Improvement (20%)
• Lead modernization of Reading systems, processes, and training through digital tools and generative AI for workflow automation, content generation, and efficiency.
• Advance integration across SharePoint, Smartsheet, LMS, and vendor platforms to enhance coordination, transparency, and reporting.
• Define annual technical and MVP requirements for the scoring application, in collaboration with AP Assessment and AP Delivery leaders.
• Guide the establishment of calibration and quality configurations supporting AP calibration, rater performance, and validity standards.
• Lead data-driven retrospectives to assess rubric design, scoring performance, and training outcomes, implementing improvements across cycles.
• Lead and Manage the AP Reading and Scoring Team (15%)
• Lead a team of 3 that is responsible for the planning and execution of the annual Reading, ensuring all student responses are scored accurately and fairly, according to assessment best practices.
• Set vision and priorities for the team, track and manage progress to goals, and provide coaching and support to ensure team members meet and exceed goals, remain engaged, and contribute meaningfully to our mission.
• Cultivate an inclusive and high-achieving culture that enables all team members to live out College Board's Operating Principles effectively.
• Bring proven leadership experience and consistently embody College Board's Manager Expectations in your work.
• Lead Standard Setting and Grade Setting (10%)
• Lead the annual grade-setting process across 40+ AP subjects, ensuring all cut scores are determined through rigorous psychometric methods and established College Board standards.
• Collaborate with AP Psychometrics and AP Curriculum & Assessment Course Teams to analyze performance data and establish cut scores for multiple exam forms per subject.
• Ensure 100% of AP Exam cut scores are based on psychometric best practices, including equating or Evidence-Based Standard Setting (EBSS), to uphold fairness, validity, and reliability across administrations.
• Lead EBSS standard setting processes for selected subjects annually, partnering with Psychometrics and C&A Course Teams to develop the Briefing Book, conduct data analyses, and support the evaluation of score outcomes.
• Maintain and analyze AP Exam performance data to inform internal reporting, trend analysis, and continual improvement of exam design, scoring accuracy, and operational quality.
• Ensure that by June 30 each year, cut scores are finalized for multiple exam forms across all AP subjects, supporting valid and reliable score setting.
• Partner with AP leadership to communicate grade-setting outcomes and ensure alignment between psychometric analyses, scoring policies, and instructional intent.
• Lead the documentation, validation, and archival of standard- and grade-setting processes in compliance with College Board research and quality standards.
• Strategic Planning (10%)
• Lead annual strategic and operational planning cycles for Reading and Scoring, ensuring capacity, change initiatives, and performance metrics align with AP's strategic priorities.
• Partner with finance and operations to ensure fiscal responsibility and strategic use of resources.
• Track progress toward AP Program scoring goals and report key outcomes to AP leadership.

Benefits

• At College Board, we offer more than a paycheck—we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive.
• We're a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.
• Annual bonuses and opportunities for merit-based raises and promotions
• A mission-driven workplace where your impact matters
• A team that invests in your development and success

What This Job Offers

• Job Type: Full-time
• Career Level: Director
• Number of Employees: 1,001-5,000 employees