Search Operations E&I AIGC Quality Analyst, Spanish - Austin

Tiktok • Austin, TX

47d

About The Position

The AIGC (AI-Generated Content) team is a collective of AI related projects created by Bytedance as it shapes itself to be a key player in the everchanging and dynamic space of Large Language Models (LLMs) and other AI related products. Our team is focused on evaluating and improving the coherence and overall quality of our internal models with the help of human review. The AIGC project brings vast market knowledge to AI optimization, which produces a high impact on the experience of our real world users.

Requirements

• Bachelor's degree or above
• High verbal and written proficiency in English and Spanish. The Spanish skill set is required to evaluate quality cases from the market and other case analysis/investigations
• Knowledge about AI or related models, familiar with social media platforms.
• An in-depth understanding and familiarity with the Internet usage habits of users
• Strong ability to learn and understand

Nice To Haves

• Major in journalism, literature, mathematics, computer, medical, law, economics are preferred
• Familiar with common office software, search evaluation experience is preferred

Responsibilities

• Quality inspection of evaluated AI model data and daily tasks of specialists
• Use evaluation methods to complete daily strategy assessment of AI model quality in accordance with evaluation standard documents
• Localize the policies, be responsible for policy training, and align the policy updates
• Conduct calibration meetings with the team in the appeal process: analyze different cases, record and evaluate their performance, offer solutions and suggestions for the current problem to help the team improve the accuracy rate and alignment
• Work closely with PM (Product Manager) in order to provide feedback on data quality
• While it is assumed the QA will focus on their area of expertise, there will be occasions in which they will work on projects outside this core area that could require other capabilities, such as using assessment methods flexibly to support related projects

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level
• Industry: Broadcasting and Content Providers
• Number of Employees: 5,001-10,000 employees