Senior Data Scientist, EngThrive Insights - CoreAI

Microsoft•Redmond, WA
•$119,800 - $261,000

About The Position

Join the team defining what AI-first software engineering looks like at Microsoft. EngThrive Insights builds data products that help tens of thousands of Microsoft engineers work more productively with AI. The team collects engineering signals daily from across the software development lifecycle and partners with engineers and leaders to translate data into tools and programs that maximize AI-fueled productivity. In this role, you will be a measurement expert for EngThrive. You will design trusted metrics for developers and leaders, combine telemetry with survey data, and conduct causal analyses to understand what makes engineers more productive with AI. You will publish and present findings across Microsoft and to the broader research community, and work closely with engineering teams to turn insights into action.

Requirements

  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or a related field and at least 1 year of data-science experience; or a master's degree in one of these fields and at least 3 years of data-science experience; or a bachelor's degree in one of these fields and at least 5 years of data-science experience; or equivalent experience.
  • Data-science experience such as managing structured and unstructured data, applying statistical techniques, and reporting results.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • At least 5 years of experience measuring or researching developer productivity, developer experience, or engineering effectiveness.
  • Experience applying developer productivity frameworks such as SPACE, DORA, DevEx, or DX to define and operationalize metrics.
  • Experience applying causal inference to observational data, such as difference-in-differences, panel or fixed-effects models, or propensity methods, and designing controlled experiments.
  • Experience designing and analyzing large-scale surveys, including psychometric validation such as reliability analysis and factor analysis.
  • Experience combining system telemetry, such as pull request, build, CI/CD, and AI tool usage data, with self-reported measures.
  • Experience measuring adoption and impact of AI coding tools or agents on software developers.
  • Proficiency in Python or R and analytical query languages such as SQL or KQL.
  • Demonstrated use of AI in a daily data-science workflow.

Responsibilities

  • Partner with engineering teams and leaders to understand how they define productivity and developer experience in the context of AI, and translate their questions into testable hypotheses, metric definitions, and research studies.
  • Design, validate, and maintain developer productivity and experience metrics, balancing system telemetry with perceptual measures, documenting definitions, and building in privacy-by-design guardrails.
  • Design and analyze large-scale developer surveys, including the Engineering Experience Survey, using sound questionnaire design, sampling, and reliability and validity testing.
  • Apply causal inference, experimentation, and longitudinal methods to estimate the impact of AI tools, engineering-system investments, and team practices on productivity, quality, and satisfaction; communicate effect sizes and uncertainty clearly.
  • Use AI tools across the data science workflow, validate every AI-generated result, and remain accountable for final outputs.
  • Contribute to thought leadership through papers and talks, and collaborate with Microsoft Research and the broader developer research community to advance developer productivity research.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service