Safeguards Analyst, Account Abuse

Anthropic•San Francisco, NY

10d•$230,000 - $310,000•Hybrid

About The Position

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. Anthropic is an AI safety and research company working to build reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our customers and society as a whole. As a Safeguards Analyst focusing on Account Abuse, you will play a critical role in building and scaling the detection, enforcement, and operational capabilities that protect our platform against scaled abuse. Important Context: In this position, you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.

Requirements

2+ years of experience in risk scoring, fraud detection, trust and safety, or policy enforcement
Hands-on experience building detection systems, risk models, or enforcement processes and workflows
Experience evaluating and integrating third-party data sources into detection or scoring pipelines
Strong SQL and Python skills — this role involves heavy data analysis across complex, multi-table data relationships
Familiarity with identity signals such as device fingerprinting, account linking, or entity resolution, or experience with appeals processes and customer-facing enforcement communications
Demonstrated ability to analyze complex data problems and translate findings into actionable improvements
Strong written and verbal communication skills — ability to explain technical tradeoffs and navigate cross-functional stakeholder conversations
Equivalent practical experience or a Bachelor's degree in Computer Science, Data Science, or related field

Nice To Haves

Have built risk scores, detection systems, signal pipelines, or enforcement processes in a previous role — identity verification, trust and safety, or similar
Are comfortable working with ambiguous, noisy data and extracting meaningful signal
Think critically about signal quality and enforcement performance — evaluating whether new detection signals or processes meaningfully improve outcomes
Have experience with graph-based data, account-linking problems, or cross-functional process design
Are proactive about identifying gaps in existing detection or enforcement and proposing new approaches
Have experience leveraging generative AI tools to support analytical, detection, or enforcement workflows
Can balance deep analytical work with cross-functional collaboration and stakeholder coordination
Have a background or interest in cybersecurity or threat intelligence (a plus, not a requirement)

Responsibilities

Develop and iterate on account signals and prevention frameworks that consolidate internal and external data into actionable abuse indicators
Develop and optimize identity and account-linking signals using graph-based data infrastructure to detect coordinated and scaled account abuse
Evaluate, integrate, and operationalize third-party vendor signals — assessing whether new data sources provide genuine lift in detection
Expand internal account signals with new data sources and behavioral indicators to improve detection coverage
Build and maintain processes that evaluate new product launches for scaled abuse risks, working closely with product teams to ensure enforcement readiness
Operationalize and iterate on enforcement tooling — including appeals workflows, review processes, and user communications — to maintain quality and scale with growing volume
Analyze enforcement performance through operational metrics, partnering with the team to keep detection accurate as abuse patterns evolve
Manage payment fraud and dispute operations to protect revenue and maintain our standing with payment partners
Coordinate enforcement efforts for policy compliance gaps across products, working with relevant teams to build scalable review processes
Collaborate with cross-functional teams (Engineering, Product, Legal, Data Science) to surface new signals and translate detection capabilities into enforcement workflows
Maintain detailed documentation of signal development, enforcement processes, and operational decisions