Sr Ethernet AI Network Engineer

Vailexa•Santa Clara, CA

About The Position

The Sr Ethernet AI Network Engineer deploys, validates, and supports Ethernet fabrics for AI and HPC cluster environments. The role troubleshoots network issues from Layer 1 through Layer 4, validates readiness for distributed training and high-volume east-west traffic, and diagnoses performance problems involving congestion, packet loss, buffer pressure, microbursts, PFC, QoS, MTU, routing, and oversubscription. The engineer works with Linux, storage, and cluster deployment teams to identify host-versus-network fault domains, executes network change plans, and uses packet-level and counter-based evidence for root cause analysis. The position also establishes operational standards for cable mapping, port policy consistency, and fabric health validation.

Requirements

  • At least 7 years of experience in large-scale data center networking, including high-bandwidth Ethernet fabrics.
  • Strong experience with spine-leaf design, routing, switching, and production troubleshooting.
  • Hands-on skill with BGP, EVPN/VXLAN, MLAG, ECMP, QoS, PFC, RoCE considerations, and telemetry interpretation.
  • Experience validating optics, breakout configurations, cable plant integrity, and port-level consistency.
  • Proven ability to troubleshoot distributed application impact caused by network behavior.
  • Comfort using switch CLI, automation tooling, and packet/counter analysis workflows.
  • Strong documentation habits for topology, incident timelines, and remediation plans.

Nice To Haves

  • Direct experience with AI fabrics carrying large-scale GPU collective traffic.
  • Familiarity with SONiC, Cumulus Linux, or vendor NOS platforms used in AI data centers.
  • Experience with streaming telemetry, Prometheus/Grafana, and network SRE operating models.

Responsibilities

  • Deploy, validate, and support Ethernet fabrics for AI and HPC cluster environments.
  • Troubleshoot Layer 1 through Layer 4 issues involving optics, transceivers, cabling, link bring-up, VLANs, MLAG, ECMP, BGP, underlay/overlay reachability, congestion, and packet loss.
  • Validate network readiness for distributed training and large east-west traffic patterns.
  • Diagnose performance issues related to buffer pressure, microbursts, PFC behavior, QoS policy, MTU mismatch, routing instability, and oversubscription.
  • Work with Linux, storage, and cluster deployment teams to isolate host-versus-network fault domains.
  • Review and execute change plans for switch provisioning, firmware upgrades, topology expansion, and maintenance events.
  • Capture packet-level and counter-based evidence to support root cause analysis.
  • Build operational standards for cable mapping, port policy consistency, and fabric health validation.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service