Software Engineer, Inference

ByteDanceSan Jose, CA
85d

About The Position

ByteDance, founded in 2012, is on a mission to inspire creativity and enrich life through its diverse suite of products, including TikTok and various platforms tailored for the Chinese market. The company emphasizes the importance of creation, not just in its products but also within its teams, fostering an environment where challenges are seen as opportunities for learning and innovation. The ByteDance Doubao (Seed) Team, established in 2023, is focused on pioneering advanced AI foundation models, aiming to lead in cutting-edge research and drive technological and societal advancements. This team is committed to AI research across various domains, including deep learning, reinforcement learning, and AI safety, leveraging substantial data and computing resources to develop proprietary models with multimodal capabilities. The Machine Learning (ML) System sub-team is tasked with combining system engineering and machine learning to create and maintain distributed ML training and inference systems globally, ensuring high performance and reliability.

Responsibilities

  • Develop and optimize LLM inference framework.
  • Optimize GPU and CUDA performance to create a high-performance LLM inference engine.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service