Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD)

ByteDance • Seattle, WA

85d

About The Position

Founded in 2023, the ByteDance Doubao (Seed) Team, is dedicated to pioneering advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal advancements. With a strong commitment to AI, our research areas span deep learning, reinforcement learning, Language, Vision, Audio, AI Infra and AI Safety. Our team has labs and research positions across China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, we have developed a proprietary general-purpose model with multimodal capabilities. In the Chinese market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and is available to external enterprise clients via Volcano Engine. Today, the Doubao app stands as the most widely used AIGC application in China. The Student Researcher position provides unique opportunities that go beyond the constraints of our standard internship program, allowing for flexibility in duration, time commitment, and location of work.

Responsibilities

• Research and develop our efficient machine learning systems, including efficient optimizers, parameters, and gradient efficient training with rank reduction and communication compression.
• Develop a state-of-the-art asynchronous training framework ensuring convergence.
• Implement both general purpose training framework features and model specific optimizations (e.g. LLM, diffusions).
• Improve efficiency and stability for extremely large scale distributed training jobs.

What This Job Offers

• Career Level: Intern
• Industry: Publishing Industries
• Number of Employees: 5,001-10,000 employees