Senior AI Data Center Network Engineer

Bitdeer Technologies Group • Needham, MA

8d • Onsite

About The Position

We are seeking an experienced and highly skilled Senior AI Data Center Network Engineer to join the Bitdeer AI Cloud team in the US. In this role, you will architect, deploy, and operate high-performance, high-availability network solutions for our large-scale GPU clusters. You will be instrumental in ensuring the stability, low latency, and optimal performance of our AI infrastructure, focusing heavily on advanced networking technologies such as InfiniBand, RoCEv2, and SDN architectures. You will collaborate with cross-functional teams to build the backbone of our AI Cloud, enabling cutting-edge AI training and inference workloads for our global customers.

Requirements

• Bachelor's degree or above in Computer Science, Network Engineering, Telecommunications, or a related field.
• Minimum 8-10 years of experience in large-scale data center network operations, architecture, and engineering.
• Deep expertise in the TCP/IP protocol stack and core routing protocols (BGP, OSPF, ISIS), as well as Data Center technologies (VXLAN EVPN, Spine-Leaf).
• Extensive hands-on experience with HPC/AI networking: InfiniBand architecture, Subnet Manager, or Ethernet-based RoCEv2, including PFC, ECN, and congestion control mechanisms.
• Proficiency in configuring and managing data center switches and routers from major vendors (e.g., Cisco Nexus, NVIDIA/Mellanox, Juniper).
• Strong skills in network automation and scripting (Python, Ansible, Terraform) and Linux system administration.
• Experience with Kubernetes container networking (CNI) and cloud-native architectures.
• Professional fluency in English and Chinese is required to effectively collaborate with global teams.

Responsibilities

• Architect scalable, high-availability network solutions for AI Cloud Data Centers, including Spine-Leaf topology, DCN, DCI, and backbone networks using VXLAN EVPN and SDN technologies.
• Design, deploy, and optimize large-scale GPU clusters utilizing InfiniBand and RoCEv2 (Lossless Ethernet) fabrics. Configure and manage NVIDIA Spectrum/Quantum series switches.
• Lead deep-dive investigations into complex network issues affecting AI workloads, such as RDMA packet loss, congestion control (PFC/ECN), latency, and NCCL communication timeouts.
• Develop and maintain network automation tools and platforms using Python, Ansible, and Terraform to implement Infrastructure as Code (IaC) and streamline configuration management.
• Utilize tools like NVIDIA UFM (Unified Fabric Manager), NetQ, Zabbix, and Prometheus to ensure real-time monitoring, network telemetry, and overall fabric health.
• Support network integration for Kubernetes/Docker container environments and hybrid cloud deployments, ensuring seamless connectivity and security.
• Lead critical network changes, capacity expansions, and firmware upgrades. Provide rapid response to incidents, implement mitigations, and conduct Root Cause Analysis (RCA).

What This Job Offers

• Job Type: Full-time
• Career Level: Senior