Senior Software Engineer - Efficient ML

ByteDance • San Jose, CA

67d

About The Position

The Vision Engineering Team at ByteDance is at the forefront of delivering GenAI technologies directly into the ByteDance products worldwide. Leveraging our proprietary AI infrastructures, we streamline the creation, integration, testing, and deployment of the GenAI features. This also encompasses large-scale training stability and optimization for acceleration, as well as large model inference and multi-machine multi-card deployment. Our work enhances user experience by powering diverse functionalities, including visual enhancements, video editing tools, and creative camera filters, both within ByteDance and other applications. The team is looking for strong software engineers who can take initiatives to design and implement highly efficient engineering systems for generative AI tasks, including but not limited to model training and optimization, model deployment with efficient hardware consumption, and applications such as image/video processing and interactive editing.

Responsibilities

• Develop algorithm acceleration technologies for text-to-image/text-to-video models through knowledge distillation, model architecture redesign (dynamic MoE routing/sparse attention), and parameter-efficient design (low-bit quantization) to achieve order-of-magnitude efficiency gains.
• Lead generative model innovation with focus on diffusion acceleration (sampling step reduction/latent optimization), autoregression model efficiency.
• Collaborate cross-functionally to identify performance bottlenecks, optimize vision models via algorithmic breakthroughs, and enhance ByteDance's product capabilities.

What This Job Offers

• Industry: Publishing Industries
• Number of Employees: 5,001-10,000 employees