Senior Network Engineer for Industrial AI Cloud

Deutsche Telekom IT Solutions Slovakia

5d•$1,850•Remote

About The Position

NVIDIA and Deutsche Telekom are jointly developing the world’s first industrial AI cloud for European manufacturers. This AI factory in Germany will host 10,000 GPUs across NVIDIA DGX B200 systems and RTX Pro Servers. Deutsche Telekom provides secure, sovereign and fast infrastructure, including data centers, operations, security, and AI solutions. We are seeking a Senior Network Engineer for Industrial AI Cloud to build and automate network platform for automation and operation related network components such as Switches, Firewalls, Routers, Border Gateways as part of core environment of the Industrial AI Cloud. In this role you will provision and manage above mentioned stack, implement and fine-tune monitoring, and deploy additional components if necessary. You’ll be working and coordinating between multiple teams (such as Infrastructure, Platform) to deliver and continuously improve infrastructure services following ITIL processes. Senior Network Engineer considers and implements design to enable automated configuration management, release management, build, test and deployment activities. This is a customer facing role/ tailor made solutions and implementations for the customer including consultancy. Proprietary technologies used for managing above scope: InfiniBand, Cumullus OS, RoCE, UFM, FortiGate friewalls, Cisco Border gateways.

Requirements

Master’s degree in Information Technologies
Experience with Network installation, maintenance, operations
NVIDIA/Mellanox switch configuration & UFM management
Data Center routing & BGP/OSPF; ASNs, IP Transit, peering, failover connectivity
Linux networking (Cumulus/Ubuntu/Debian); configuring bridges, bonds, VLANs, routing tables
Tools: iperf, ethtool, nvidia-smi, perfquery, NVIDIA/Mellanox diagnostics
Monitoring, incident detection & root-cause analysis in large-scale DC networks
Firewall & security management (FortiGate: policies, NAT, VPNs, IDS/IPS, HA); security segmentation, DDoS mitigation, and zero-trust networking
Switch provisioning, firmware/OS upgrades, patching, config backups
VMware (VMware Tanzu Kubernetes)
Scripting (Go/Python/Bash)
Automation tools (Ansible, SaltStack, Terraform, Helm)
CI/CD in Kubernetes environments; repository management
Git-based automation (GitHub/GitLab) & CI/CD tools (GitHub Actions/GitLab CI)
Linux OS administration
Software-Defined Networking (SDN)
Monitoring & visualization (Grafana, Prometheus)
Deep understanding of InfiniBand architecture, RoCE, low-latency/high-throughput networking for AI/HPC
Deep understanding of ITIL processes (incident, problem, change)
Deep understanding of Industrial AI Factory Cloud platform stack and its dependencies
Deep understanding of NVIDIA GPU-accelerated server platforms
Deep understanding of Data engineering, transformation & migration tools
Deep understanding of Kubernetes or similar container-based technologies
Familiarity with NOC/SOC operations and on-call rotation models
Good communication skills
Analytical thinking
Team cooperation
Presentation skills
Negotiation skills
English - Advanced (C1)
Basic Project Management skills
Basic Leadership skills
Intermediate Quality management skills
Intermediate Financial literacy skills

Nice To Haves

German is an advantage

Responsibilities

Coordinate and support network lifecycle activities (installs, upgrades, changes, firmware updates) and manage /network interconnections and related documentation.
Provision and maintain InfiniBand switches according to ITIL Standards.
Develop and maintain automation scripts to orchestrate overall scope.
Fine tuning, configuration changes through whole project lifetime.
Maintain network-based environments, apply patches, and manage firmware upgrades at scale.
Follow and improve incident, problem, and change management workflows; document runbooks and standard operating procedures.
Adhere to ZERO Outage guidelines.
Work closely with Platform Engineers and AI solution teams to ensure smooth deployments and operations.
Manage a unified network fabric utilizing both InfiniBand and Ethernet / RoCE technologies.
Manage a separate 1 Gbps Ethernet and serial console for out-of-band (OOB) network management.
Design, develop, test, implement and support ICT components and applications in order to deliver quality standard product portfolio on AI Factory Cloud platform.
Build and develop concepts, processes and methods for automation, optimization, and standardization to satisfy efficiency and automation requirements.
Provide advice or information at request or at own initiative to all relevant employees or customers regarding technical aspects of products.
Provide project deliverables to fulfil the project scope.
Consult and implement new innovative technologies to satisfy innovation strategy.
Provide overall solutions and principles in planning, developing, and implementing new products to satisfy business requirements.
Develop, and implement architecture of services based on AI Factory Cloud platform requirements.
Mentor and train co-workers to spread knowledge level and develop their skills.
Act as key technical lead and solve and coordinate activities across related technologies/outside own team.
Provide consulting services to project teams on areas of expertise.
Research and development in assigned technology, determine business requirements, propose changes and develop implementation plans.
Participation on on-call duties, independent solving and troubleshooting of incidents and errors within defined expertise.