Trust and Safety Engineer

FiveBy • Seattle, WA

2d • $129,000 - $202,000 • Remote

About The Position

FiveBy is a high-end anti-fraud and online security consultancy headquartered in Seattle with operations across the United States. We are a motivated group of specialized professionals united under the mission to provide the programs, services, and expertise our clients need to protect their products and customers. With the ever-increasing frequency of fraud, piracy, and other commercial risk, there has never been a better time to join the fight against online crime.

We’re hiring a Trust & Safety Engineer to analyze threat actor behavior, detect emerging abuse patterns across large datasets, and design production-ready mitigations that keep the platform safe without slowing developers.

This role blends security engineering, data analysis, and applied LLM techniques, partnering closely with Product, Infrastructure, and Security to turn evolving threats into scalable defenses.

This is a remote role and may be seated anywhere in the US, however significant overlap with core hours in the Pacific time zone may be required.

Requirements

• 4+ years software engineering experience (or equivalent) building production systems.
• Full-stack experience with React + TypeScript (internal tools / ops UIs strongly preferred).
• Backend engineering experience: designing APIs/services, workflow/state machines, and production integrations.
• Experience with databases (SQL) and caching/queues such as Redis.
• Demonstrated ability to work with large datasets to identify patterns, ship mitigations, and measure impact.
• Ability to integrate new detection products into existing moderation workflows (queues, triage, reviewer ops, appeals, auditing).

Nice To Haves

• Prior Trust & Safety / abuse prevention / content moderation or security engineering experience at a UGC or live platform.
• Experience working with moderation classification or ML systems (CV/NLP/audio), vendor tooling, and production rollout patterns.
• Applied LLM experience: evaluation pipelines, red-teaming/adversarial testing, drift monitoring, and safe automation.
• Familiarity with policy enforcement concepts (graduated enforcement, appeals, auditability, transparency-style metrics/reporting).

Responsibilities

• Analyze threat actor behavior and evolving abuse patterns across large, heterogeneous datasets (livestreams, chat, follows, gifts/coins, reports, device/account signals) to inform detection logic, policy decisions, and mitigations.
• Design and develop production-ready detection and enforcement systems that disrupt abusive behavior in real time (risk scoring, rate limits, automated actions, human-in-the-loop review, ban evasion controls).
• Build and maintain internal moderation tools: case management, evidence capture, appeals, and audit trails to optimize for speed, consistency, and operator wellbeing.
• Research, prototype, and implement LLM-driven techniques for abuse detection, classification, and prevention (e.g., policy-aware triage, semantic clustering of new attack patterns, reviewer assist, automated labeling with evaluation gates).
• Integrate ML/moderation classification systems (e.g., computer vision, text moderation, speech/audio signals; vendors such as Hive / Rekognition-like services / OpenAI) into your existing moderation structures with strong safeguards (thresholding, fallbacks, debuggability, measurement)
• Design and maintain backend services that power Trust & Safety workflows (APIs, streaming/near-real-time pipelines, event logs, idempotent enforcement).
• Own data systems: SQL-backed models and analytics, plus caching/queues like Redis for fast, consistent tooling and enforcement decisions.
• Operationalize policy into systems (including transparency/accountability considerations like CA AB 587 reporting-style rigor where relevant).

Benefits

• FiveBy employees are eligible to participate in FiveBy’s group medical, dental, and vision insurance plans.
• FiveBy covers 100% of monthly premiums for individual employees – additional qualifying beneficiaries may be added at the expense of the sponsoring employee.
• FiveBy also provides 401k with employer matching, 120 hours of PTO annually (pro-rata for hourly employees), and 10 paid holidays per year.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed