Research Scientist, LLM Model Evaluation(Seed), PhD Graduates- 2025 Start

ByteDance • San Jose, CA

100d

About The Position

The ByteDance Seed team, established in 2023, is dedicated to discovering new approaches to general intelligence and pushing the boundaries of AI. Our research spans large language models, speech, vision, world models, AI infrastructure, next-generation interfaces, and more. With a long-term vision and determination in AI, the ByteDance Seed team remains committed to foundational research. We aim to become a world-class AI research team that drives real technological progress and delivers societal benefits. With labs across China, Singapore, and the U.S., our team has already released industry-leading general-purpose large models and advanced multimodal capabilities, powering over 50 real-world applications - including Doubao, Coze, and Jimeng.

Responsibilities

• Explore the intrinsic consistency of models across pre-training and post-training stages, and predict LLM performance limits.
• Design better evaluation methods based on internal mechanisms of models, with a focus on interpretability.
• Design and develop novel benchmarks to systematically evaluate model capabilities and support the formalization of AGI definitions.
• Conduct red teaming from an evaluation perspective to identify model limitations and propose targeted improvements.
• Define the necessary evaluation standards to explore next-generation models and intelligent applications, such as Agent Foundation Models and DeepResearch.

What This Job Offers

• Industry: Publishing Industries
• Number of Employees: 5,001-10,000 employees