Research Scientist Intern - Video Generation

HoYoverse • Mountain View, CA

3d

About The Position

As a Video Generation Research Intern, you will work closely with research and engineering teams to advance post-training techniques for large-scale video generation models, focusing on controllability, generation quality, and temporal consistency. You will explore cutting-edge generative modeling techniques and contribute to next-generation AI-powered content creation and interactive virtual world experiences.

Requirements

• Currently pursuing a Master's or PhD degree in Computer Science, Artificial Intelligence, Computer Vision, Machine Learning, or a related technical field.
• Strong research background and hands-on experience in video generation, including training or fine-tuning video generative models.
• Solid understanding of modern generative modeling techniques, such as diffusion models, flow matching, Diffusion Transformers (DiTs), and autoregressive models.
• Strong proficiency in Python and deep learning frameworks such as PyTorch.
• Ability to independently implement research ideas, conduct experiments, analyze results, and collaborate effectively with a research team.

Nice To Haves

• Publications at top-tier AI and computer vision conferences, such as CVPR, ICCV, ECCV, ICML, ICLR, or NeurIPS; first-author publications related to video generation, especially controllable video generation, are strongly preferred.
• Research experience in controllable video generation, including camera control, motion control, trajectory-guided generation, action-conditioned generation, or interactive video generation.
• Experience with large-scale video model training, distributed training, or training and inference optimization.
• Contributions to influential open-source video generation projects or research implementations.

Responsibilities

• Research, develop, and implement post-training methods for video generation models, including supervised fine-tuning, preference optimization, and reinforcement learning-based approaches.
• Explore controllable video generation techniques to improve motion control, camera movement, trajectory following, and action-conditioned generation.
• Design and conduct experiments to improve video generation quality, temporal consistency, motion realism, and alignment with user instructions.
• Collaborate with researchers and engineers to develop training pipelines, evaluation benchmarks, and scalable experimentation workflows.
• Stay up to date with advances in video generation and generative AI, and contribute to research publications and practical applications.

What This Job Offers

• Career Level: Intern