Lead Generative AI Analyst

Welocalize • San Francisco, CA

1d

About The Position

The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.

Requirements

• Proven track record of delivering quality products on time.
• Native-level English proficiency with excellent written and verbal communication skills.
• Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
• Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
• 4-year accredited college degree or equivalent experience.

Nice To Haves

• Over 1 year of experience delivering products in the LLM space.
• College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
• Deep understanding of large language models and RLHF.
• Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
• QA/testing experience.
• Python scripting skills are a plus.

Responsibilities

• Lead technical and writing teams to deliver NEMO products.
• Act as the liaison between customers, DataFactory teams, product teams, and research teams.
• Track annotator metrics to ensure top-quality deliverables.
• Write creative prompts and responses across diverse topics.
• Manage labeling initiatives with third-party firms and internal customers.
• Develop and update detailed guidelines and specifications for stakeholders.
• Train teams on best practices for creating large language models and datasets.
• Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).

What This Job Offers

• Job Type: Full-time
• Career Level: Senior