Applied Data Scientist / Assessment Data Scientist

College Board•San Juan, PR

7h•Hybrid

About The Position

The ( Applied Data Scientist / Assessment Data Scientist ), internally known as, Associate Director, Psychometric Operations & Data Science, plays a hands-on role in strengthening the accuracy, efficiency, and innovation of CB-LATAM’s psychometric and operational data workflows. You will design and maintain automated data pipelines that enable scoring, scaling, and reporting processes to run smoothly and reproducibly. You will also perform item calibration, statistical analysis, and quality control to support scoring operations and ensure that the item bank remains current, valid, and reliable. By improving data workflows and implementing analytics-driven solutions, you will help modernize psychometric operations and embed quality controls throughout the data lifecycle. Beyond R&M, you will also serve as CB-LATAM’s data governor—understanding what comes in and what goes out, where it’s stored, how long it’s stored, and what it’s used for. You will act as an owner of the architecture of our data, ensuring its integrity, accessibility, and compliance with internal policies and professional standards. Working in close partnership with Psychometricians, R&D staff, and Technology teams, you will apply advanced statistical and programming skills to streamline complex workflows, automate recurring processes, and transform data into actionable insights. This role is ideal for a technically skilled and analytically curious professional who wants to contribute directly to evidence -based innovation in educational measurement, while ensuring that CB-LATAM’s data systems are accurate , policy-compliant, and future-ready.

Requirements

Master’s degree in Statistics, Data Science, Psychometrics, or related field .
5–8 years of experience in data analytics, psychometric operations, or applied quantitative research.
Proficiency in R, Python, SQL, and data visualization tools (Tableau, Power BI).
Working knowledge of IRT and CTT models, scaling, and equating procedures.
High attention to data quality, compliance, and ethical standards and the ability to dissect complex data problems, troubleshoot issues, and craft actionable solutions.
Experience leveraging data insights to influence both operational and strategic decisions.
Skilled in automation, analytical rigor, programming proficiency and reproducible workflow design.
Ability to travel 1-2 times a year to College Board offices or on behalf of College Board business.
Bilingual proficiency in Spanish and English.
A passion for expanding educational and career opportunities and mission-driven work
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely , respectful feedback, and continuously improving through iterative learning and user input.
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success
Authorization to work in the United States

Responsibilities

Support scoring operations through quality assurance routines, data validation, and review of scoring keys, parameters, and distributions.
Maintain and update the item bank database, ensuring data accuracy, version control, and metadata integrity.
Execute item calibrations and test-level analyses using classical test theory (CTT) and item response theory (IRT) models.
Conduct statistical and psychometric analyses for pretests, operational forms, and field test data.
Collaborate with Psychometricians to ensure operational equating and scaling are performed with precision and consistency.
Serve as CB-LATAM data governor: overseeing data flow, architecture, and lifecycle management across psychometric and operational systems.
Ensure that all data systems comply with College Board governance policies, professional testing standards, and privacy requirements.
Monitor data inflow/outflow and document data usage, ensuring transparency and ethical stewardship.
Implement reproducible scripts and validation routines (in R or Python) to standardize workflows.
Build, maintain , and automate data pipelines for scoring, equating, and reporting.
Contribute to research documentation, technical reports, and internal publications summarizing results and innovations.
Develop dashboards and visualizations that summarize psychometric and operational indicators.
Identify opportunities to automate repetitive processes, reduce manual dependencies, and strengthen quality assurance.
Apply AI and machine learning techniques to detect data anomalies and enhance workflow efficiency.
Partner with Psychometricians, Technology, and R&D staff to deploy analytic solutions into production environments and improve system interoperability and reporting efficiency.