Senior Research Scientist/Engineer - AI Infrastructure

ByteDance • San Jose, CA

85d

About The Position

We are seeking a highly skilled and motivated AI Infrastructure Engineer to join our dynamic team. In this role, you will be responsible for designing, building, deploying, and maintaining the robust and scalable infrastructure that powers our cutting-edge artificial intelligence (AI) and machine learning (ML) initiatives. You will work closely with our AI/ML researchers, data scientists, and software engineers to create an efficient, high-performance environment for training, inference, and data processing. Your expertise will be critical in enabling the next generation of AI-driven products and services.

Responsibilities

• Lead end-to-end design of scalable, reliable AI infrastructure (AI accelerators, compute clusters, storage, networking) for training and serving large ML workloads.
• Define and implement service-oriented, containerized architectures (Kubernetes, VM frameworks, unikernels) optimized for ML performance and security.
• Profile and optimize every layer of the ML stack-ML Compiler, GPU/TPU scheduling, NCCL/RDMA networking, data preprocessing, and training/inference frameworks.
• Develop low-overhead telemetry and benchmarking frameworks to identify and eliminate bottlenecks in distributed training and serving.
• Build and operate large-scale deployment and orchestration systems that auto-scale across multiple data centers (on-premises and cloud).
• Champion fault-tolerance, high availability, and cost-efficiency through smart resource management and workload placement.
• Architect and implement robust ETL and data ingestion pipelines (Spark/Beam/Dask/Flume) tailored for petabyte-scale ML datasets.
• Integrate experiment management and workflow orchestration tools (Airflow, Kubeflow, Metaflow) to streamline research-to-production.
• Partner with ML researchers to translate prototype requirements into production-grade systems.
• Mentor and coach engineers on best practices in performance tuning, systems design, and reliability engineering.

What This Job Offers

• Industry: Publishing Industries
• Number of Employees: 5,001-10,000 employees