Senior Network Engineer
About The Position
The Senior Network Engineer is responsible for the design, deployment, maintenance, optimization, and troubleshooting of high-performance AI infrastructure networks supporting GPU compute clusters, storage fabrics, and large-scale AI workloads. This role focuses on High-Speed Ethernet, InfiniBand, EVPN/VXLAN fabrics, BGP routing, GPU cluster networking, storage integration, and secure multi-tenant AI environments. The ideal candidate will possess deep experience with hyperscale or HPC networking, AI cluster deployments, data center operations, and advanced troubleshooting across compute, storage, and network fabrics.
Requirements
- 5+ years of enterprise or data center networking experience.
- 2+ years supporting AI, HPC, or GPU cluster environments.
- Strong experience with: BGP, EVPN/VXLAN, VLANs, MLAG, High-Speed Ethernet (100G/200G/400G/800G), InfiniBand, Cumulus.
- Experience with NVIDIA UFM and AI fabric management.
- Strong Linux administration skills.
- Experience troubleshooting GPU cluster communication issues.
- Experience with enterprise firewalls and network segmentation.
- Understanding of AI workload traffic patterns and storage networking.
Nice To Haves
- Experience with: WEKA, RoCEv2, NCCL, Kubernetes, Slurm, CUDA environments.
- Experience deploying Supermicro Datacenter Building Block Solutions (SMDCBBS).
- Familiarity with liquid-cooled GPU infrastructure.
- Experience with AI inference and training environments.
- Scripting or automation experience: Python, Bash, Ansible, API integrations.
Responsibilities
- Design and maintain High-Speed Ethernet and InfiniBand fabrics for GPU clusters.
- Deploy and manage EVPN/VXLAN spine-leaf architectures.
- Configure and maintain BGP routing, VRFs, VLANs, MLAG, and high-availability networking.
- Design resilient AI infrastructure supporting multi-tenant environments and large-scale GPU workloads.
- Optimize east-west traffic flows for AI training and inference workloads.
- Support NVIDIA GPU cluster networking including: NCCL optimization, GPUDirect RDMA, RoCEv2, InfiniBand subnet management.
- Troubleshoot cluster communication issues including: Link flapping, Congestion, Latency, Throughput bottlenecks.
- Execute and validate NCCL performance testing.
- Deploy and support high-performance storage platforms including WEKA and distributed AI storage systems.
- Configure storage VLANs, passthrough networking, and bonded interfaces.
- Optimize storage throughput and low-latency communication between compute and storage environments.
- Configure and maintain enterprise firewalls including: NAT, VIPs, VPN/IPSec, Traffic shaping, Security segmentation.
- Implement secure multi-tenant access controls.
- Assist with AI governance and controlled AI integration environments.
- Develop infrastructure automation for: Network provisioning, Firewall policy deployment, VLAN assignments, Server imaging.
- Implement monitoring and alerting through Grafana and telemetry systems.
- Support API-driven infrastructure management and orchestration.
- Assist with deployment and operational planning for AI data center infrastructure.
- Support Tier III resiliency planning and redundancy validation.
- Coordinate with facilities, power, mechanical, and external ISP providers.
Benefits
- medical, dental, vision, life, and short-term and long-term disability insurance, as well as paid time off.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
