Language Measurement Scientist

Duolingo•Pittsburgh, PA
•$110,500 - $149,500

About The Position

Duolingo is seeking a language assessment expert to support test development and research for the Duolingo English Test. The Language Measurement Scientist will join the Assessment Research and Development team and collaborate across disciplines to design and evaluate innovative language assessments. The work focuses on ensuring that assessment tasks and scores are valid, reliable, and fair. The role includes developing research-driven assessments, designing and evaluating assessment tasks (including interactive formats), conducting qualitative and quantitative studies, and applying language assessment and measurement principles to test design, content, scoring, and quality assurance. The scientist will communicate findings and recommendations to technical and non-technical partners and share research with professional and academic audiences.

Requirements

  • PhD in language testing, applied linguistics, second language acquisition, educational measurement, or a related field.
  • Experience developing or conducting research on high-stakes language assessments, or comparable professional experience.
  • Expertise in language assessment, including test design, validity, reliability, fairness, and the measurement of language proficiency.
  • Experience designing and analyzing qualitative and quantitative research studies.
  • Experience communicating research through publications, reports, or presentations.
  • Ability to explain complex measurement concepts clearly to collaborators from different disciplines.
  • Proficiency with data-analysis tools such as R or Python.
  • Strong collaboration, project-management, and organizational skills.

Nice To Haves

  • Experience applying large language models, natural language processing, or related technologies to language assessment.
  • Experience collaborating with software engineers or AI researchers to develop digital assessment products.
  • Experience designing or developing computer-adaptive tests.
  • Expertise in evidence-centered design, interactive-task development, or integrated-skills assessment.

Responsibilities

  • Collaborate with measurement researchers, engineers, and designers to develop innovative, research-driven language assessments.
  • Design and evaluate assessment tasks, including new interactive item formats.
  • Conduct qualitative and quantitative studies examining the validity, reliability, and fairness of assessment tasks and test scores.
  • Apply language assessment and measurement principles to improve test design, content, scoring, and quality assurance.
  • Translate research findings into clear recommendations for technical and non-technical partners.
  • Share findings through technical reports, research publications, blog posts, and presentations to professional and academic audiences.

Benefits

  • Equity compensation in addition to base salary.
  • Employee benefits supporting holistic well-being.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Senior

Education Level

Ph.D. or professional degree

© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service