Alibaba Cloud-RDMA Ops Engineer - Computing Infrastructure Networking-Sunnyvale

Alibaba Group • Sunnyvale, CA

68d • $104,400 - $171,000

About The Position

We're seeking a skilled RDMA Ops Engineer to optimize and maintain high-performance networking infrastructure for our computing clusters. This role focuses on building and operating ultra-low latency, high-throughput networks using RDMA technologies to power next-generation computing workloads.

Requirements

• Strong scripting skills (Python/Go/Bash) for operational automation
• Expert-level RDMA operational experience (RoCEv2/InfiniBand)
• Understanding of Linux internals (kernel bypass, syscall optimization, etc.) and proficient in Linux network stack tuning (irqbalance, NUMA, hugepages)
• Hands-on experience with RDMA/DPDK performance tuning
• Strong knowledge of network protocols (TCP/IP, RoCEv2) and NIC architecture principles
• Ability to abstract complex technical concepts into architectural diagrams
• Proven track record of translating R&D innovations into production solutions
• Strong communication skills for cross-functional collaboration with Computing researchers and SRE teams

Nice To Haves

• Have experience on managing production Computing networks
• Familiar with Kubernetes networking (CNI, Multus, SR-IOV) and GPU-aware scheduling
• Background in Computing system optimization (NVIDIA collective libraries, MPI tuning)
• Deep understanding of Computing workload patterns and their network implications

Responsibilities

• Deploy, operate and maintain RDMA-based network architectures (RoCE/InfiniBand) for cluster with thousands of nodes
• Optimize network performance for distributed collective communication workloads (NCCL, MPI, etc.)
• Solve complex network issues in distributed collective communication (e.g., NCCL/MPI communication bottlenecks)
• Use automation tools for network provisioning, monitoring, diagnostics, and network performance profiling (latency/throughput analysis)
• Implement CI/CD pipelines for network infrastructure-as-code
• Manage end-to-end network lifecycle: deployment, configuration, monitoring, upgrades
• Collaborate with computing algorithm engineers to troubleshoot network-related bottlenecks in training/inference pipelines
• Bridge Computing framework requirements with underlying network infrastructure capabilities
• Ensure compliance with security and scalability requirements

Benefits

• The pay range for this position at commencement of employment is expected to be between $104,400 and $171,000/year.

What This Job Offers

• Industry: Sporting Goods, Hobby, Musical Instrument, Book, and Miscellaneous Retailers
• Number of Employees: 5,001-10,000 employees