Senior Infrastructure Engineer

Deep Infra Inc. • Palo Alto, CA

1d

About The Position

DeepInfra is building the foundation for companies to use modern AI in production — simply, reliably, and at scale. Our team has deep experience building large systems that serve hundreds of millions of users, and we're bringing that same level of rigor to a rapidly evolving AI inference space. Our mission is to make advanced AI available to people and teams everywhere.
We're an early, tight-knit team where you can influence product direction, try bold ideas, and drive meaningful work forward quickly. If you want to join a fast-growing company at a defining moment, we'd love to talk.
DeepInfra is backed by leading investors including A.Capital, Felicis, 500 Global, Georges Harik, Samsung Next, Supermicro, Upper90, Peak6, SVAngel, and NVIDIA.

Requirements

• Experience: 10+ years building and operating infrastructure for 24/7 production environments, including significant hands-on experience with data center infrastructure and networking.
• Data Center Networking: Deep experience designing and operating high-performance data center networks, including spine/leaf or Clos architectures, BGP, and network security. Experience with EVPN/VXLAN, transit, and peering is strongly preferred.
• Site Deployment: Experience bringing colocation or data center infrastructure online, including network design, rack layouts, cabling, hardware installation, turn-up, and coordination with on-site or remote-hands teams.
• Infrastructure Operations: Strong Linux fundamentals and the ability to troubleshoot across networking, compute, storage, and the physical layer.
• Automation: Strong scripting and automation skills using Python, Bash, Ansible, or similar tools.
• Project Ownership: Proven ability to drive complex infrastructure projects across multiple vendors, dependencies, and locations from planning through production.
• Vendor Management: Experience working directly with data center, network, or hardware vendors. Experience with capacity planning, procurement, or commercial negotiations is a strong plus.

Nice To Haves

• Experience deploying GPU infrastructure, including high-speed interconnects such as InfiniBand or RoCE and high-density power and cooling environments.
• On-prem private cloud experience with KVM, Proxmox, OpenStack, Ceph, or similar technologies.
• Kubernetes and containers in production, along with observability tooling such as Prometheus and Grafana.
• Experience managing internet resources at scale, including ASNs, IP prefixes, IRR records, and routing policy with ISPs and IXPs.
• Experience owning hardware procurement, colocation contracts, capacity planning, or infrastructure vendor negotiations.
• Source, evaluate, and secure data center and colocation space across power, cooling, density, connectivity, and cost.
• Lead commercial negotiations with data center, network, and hardware vendors across pricing, contract terms, SLAs, and expansion options.

Responsibilities

• Design, build, and operate high-performance data center networks — including spine/leaf fabrics, BGP, transit and peering, and network security — across multiple colocation sites.
• Own site bring-ups end to end: low- and high-level designs, capacity planning, rack and power layouts, cabling plans, hardware installation, turn-up, and handoff to production.
• Operate and improve the underlying infrastructure that our compute platform runs on, with strong Linux fundamentals, monitoring, and automation.
• Run infrastructure projects across multiple vendors and sites, managing timelines, dependencies, shipment and logistics coordination, and risk.
• Travel to data centers to install, connect, and troubleshoot hardware alongside remote-hands and vendor teams.
• Serve as the primary technical point of contact for data center vendors and for customers whose infrastructure we manage.
• Build repeatable playbooks, standards, and automation that make every new site faster to stand up than the last.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed