Red Teaming | Generative AI Analyst - USA (Remote)

Welo Global

1d • $33 • Remote

About The Position

We are hiring a Red Teaming | Generative AI Analyst to support generative AI safety evaluation. In this role, you will interact with AI models, create and evaluate prompts, and identify where model responses fail against defined safety expectations.

Requirements

• Native-level or near-native English proficiency with excellent written communication skills.
• Strong creative writing ability and comfort constructing varied prompts.
• Work Authorization is required for the role.
• Strong attention to detail and ability to follow complex project guidelines.
• Ability to think critically and evaluate open-ended model responses.
• Comfort working with sensitive, adult, NSFW, or policy-relevant content where required.
• Interest in generative AI, AI safety, large language models, or emerging AI technologies.
• Ability to work quickly and accurately during short production windows.

Nice To Haves

• Experience with red teaming, safety data annotation, content evaluation, safety review, content moderation, QA, or AI model evaluation preferred.
• Bachelor’s degree or equivalent practical experience preferred.
• Background in creative writing, English, linguistics, journalism, communications, policy, trust and safety, or content moderation.
• Experience evaluating generative AI prompts and responses.
• Familiarity with AI safety, red teaming, jailbreak testing, RLHF, or model evaluation workflows.
• Experience working with safety taxonomies, policy guidelines, evaluation rubrics, or defect categories.
• Prior experience reviewing sensitive, adult, NSFW, or policy-relevant content in a professional setting.
• Experience with multimodal AI workflows involving text, image, audio, or video.
• QA/testing experience within AI, data operations, content review, or annotation environments.
• Ability to explain a repeatable approach for staying consistent during high-volume, judgment-based work.

Responsibilities

• Interact with generative AI models using project-provided guidelines, safety taxonomies, and attack-vector guidance.
• Create and evaluate prompts designed to test model behavior across safety-related categories.
• Identify where model responses become unsafe, noncompliant, inconsistent, or otherwise problematic.
• Document model breakability, effort level, point of failure, and relevant category alignment.
• Review text, image, audio, video, or other multimodal content as required by the workflow.
• Apply detailed guidelines consistently across short, high-volume production sprints.
• Use sound judgment to evaluate ambiguous, edge-case, or policy-sensitive outputs.
• Conduct self-review to ensure work is accurate, complete, and aligned with project expectations.
• Flag unclear guidelines, tooling issues, or recurring model behavior patterns.
• Participate in calibration, feedback, and quality review sessions to improve consistency.
• Maintain readiness to pivot quickly between different red teaming runs when active work is launched.

Benefits

• In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.
• As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences.
• Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources.
• Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types.
• Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Associate degree