Software Engineer, Networking (Agent Infra)
About The Position
Baseten is hiring a Software Engineer for its Agent Infra team, which builds the networking stack for agent sandboxes. Each agent runs in an isolated microVM, and the team is developing user-space networking designed to connect large numbers of machines that suspend, resume, and exchange data. The stack uses VPP (FD.io) as its main data-plane technology and virtualized network functions for low-latency packet processing at scale. The role focuses on building multi-tenant virtual private networking that connects customers’ agents and services privately and securely. The engineer will develop networking as programmable software and APIs, rather than primarily configuring routers and switches. This role owns how sandboxes connect to each other, Baseten services, customer networks, and the internet; it is separate from Baseten’s GPU-to-GPU networking. The team is small, with substantial ownership and a focus on shipping in weeks and months.
Requirements
- Experience with user-space packet processing such as DPDK or VPP, or with virtualized network functions (VNF/NFV).
- Experience building multi-tenant networking in production, including technologies such as VXLAN, GENEVE, or VRF.
- Production experience building a software-defined network, overlay network, or packet-processing data plane.
- Strong systems programming skills in Rust, Go, and/or C/C++, and a track record of writing production code.
- Experience building cloud networking as a provider, rather than only consuming a cloud provider’s network.
- Solid grounding in TCP/IP and routing.
- Experience building or operating proxies, load balancers, or L4/L7 gateways at scale.
- Experience debugging latency and throughput problems using packet captures, tracing, and profiling.
- Ability to move quickly and own problems end to end on a small team.
Nice To Haves
- Experience with VPP / FD.io.
- Experience with GENEVE or VXLAN overlays and EVPN.
- Linux kernel networking experience, including eBPF/XDP, netfilter or nftables, or network namespaces.
- Familiarity with virtual machine networking, such as virtio-net, vhost, TAP devices, or networking for Firecracker or Cloud Hypervisor.
- Experience running IPv6 at scale.
- Background in telecom user-plane or 5G core networking, or low-latency trading networks.
- Experience with multi-region traffic routing, anycast, or BGP.
- Experience with TLS termination, DNS, and egress security controls.
Responsibilities
- Design and build the user-space, VPP-based data plane connecting microVM sandboxes to each other, Baseten services, and the internet.
- Build multi-tenant virtual private networking and overlays, such as EVPN, GENEVE, and VXLAN, across regions.
- Expose the network as a programmable API for the rest of the platform.
- Reduce latency and increase connection scale for agent-to-agent and agent-to-service traffic.
- Build routing that sends requests to the nearest region and maintains connections as sandboxes suspend and resume.
- Build secure sandbox ingress and egress, including firewalling, static egress IPs, and custom domains with managed TLS.
- Build L7 proxies for request inspection, filtering, secret injection, and auditing.
- Own per-sandbox addressing, including IPv6, and network isolation between tenants.
- Build observability for the packet path across guest, host, and network, and debug production issues end to end.
- Work closely with compute, storage, GPU infrastructure, and datacenter teams.
Benefits
- Competitive compensation, including meaningful equity.
- For U.S. employees: 100% coverage of medical, dental, and vision insurance for employees and dependents.
- Flexible PTO policy, including a company-wide Winter Break when offices are closed from Christmas Eve to New Year’s Day.
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- For U.S. employees: company-facilitated 401(k).
- Exposure to a variety of ML startups, offering learning and networking opportunities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
