Data Scientist, Integrity

OpenAI•San Francisco, CA
•$265,000 - $380,000

About The Position

OpenAI’s Integrity team protects people and businesses using ChatGPT, Codex, and the API from fraud, abuse, and harmful misuse. The team addresses payment and promotional abuse, compromised accounts and API credentials, business and advertiser integrity, and emerging misuse of frontier AI capabilities. It also helps product teams measure authentic usage so abuse does not distort decisions about product growth. As a Data Scientist on Integrity, you will identify emerging abuse patterns, assess their impact, and lead analytical work that informs detection, enforcement, and product-launch decisions. You will work with Product, Engineering, Research, Policy, and Operations to turn findings into improvements and measure their effects after launch. The role includes investigating anomalous activity, defining metrics and guardrails, evaluating detection and review systems, estimating the effects of interventions on both harm and legitimate users, and developing reusable datasets, analyses, and investigation tools.

Requirements

  • Fluency in SQL and Python.
  • Ability to use AI tools to investigate large, messy datasets, test hypotheses quickly, and automate recurring analyses.
  • Ability to verify AI-generated queries, code, and conclusions against underlying data.
  • Strong statistical judgment and experience with experimentation, causal inference, or observational analysis.
  • Ability to reason from incomplete or biased labels and explain how uncertainty affects decisions.
  • Ownership of open-ended problems, from deciding what to measure through recommending action and checking whether it worked.
  • Clear communication with technical and nontechnical partners and ability to explain the tradeoffs behind recommendations.

Nice To Haves

  • Experience in integrity, trust and safety, fraud or risk analytics, security analytics, or applied ML evaluation.
  • Experience evaluating detection systems, human review, or LLM-based classifiers.

Responsibilities

  • Investigate anomalous activity across products, estimate the prevalence and impact of problems, identify affected users, and recommend priorities.
  • Define outcome metrics and guardrails, establish baselines, and build monitoring for changes in abuse, customer friction, and operational performance.
  • Help build and evaluate detection rules, classifiers, and human review workflows using labeled samples and review outcomes.
  • Assess what detection and review systems miss, where they flag legitimate activity, and how errors vary across users and products.
  • Design randomized holdouts and apply quasi-experimental or observational methods when randomization is impractical.
  • Estimate harm or fraud losses prevented and effects on legitimate users, revenue, compute costs, and review workload; recommend whether to launch, expand, adjust, or retire controls.
  • Trace breakdowns in signals, review decisions, or enforcement actions and work with partners to close gaps.
  • Build reusable datasets, analyses, and investigation tools.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service