Member of Technical Staff, Traffic Infrastructure

Fireworks • San Mateo, CA

2d

About The Position

As a Member of Technical Staff on the Traffic Infrastructure team, you will own the traffic layer behind Fireworks’ generative AI platform, including proxies, load balancers, service mesh, and routing systems that move requests reliably across regions and cloud providers. The role requires expertise in distributed systems, cloud networking, and infrastructure, as well as judgment to balance latency, cost, and operational simplicity. You will partner closely with ML, product, and platform teams and help set the team’s technical direction.

Fireworks is a platform for specialized intelligence that enables companies to build, train, and serve AI models tailored to their data, workflows, and products. The company was founded by the team behind PyTorch and is a Series D company valued at $17.5 billion.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• 5+ years of experience building backend or network infrastructure in cloud environments such as AWS, GCP, or Azure.
• Strong software development skills in languages such as Go, C++, Rust, Java, or Python.
• Deep understanding of distributed systems and networking fundamentals, including performance optimization.
• Experience owning the full product lifecycle, from design through implementation to production.

Nice To Haves

• Master’s or PhD in Computer Science or a related field.
• Hands-on experience with traffic or edge engineering, service mesh, or cloud networking, such as Envoy, Istio, or DPDK.
• Deep Kubernetes experience, including ingress, network policy, and custom controllers.
• Track record of improving performance, reliability, and cost-efficiency on high-throughput systems.
• Experience leading projects across teams and coaching distributed engineers.

Responsibilities

• Architect and build scalable, fault-tolerant traffic and networking services, including ingress and egress, load balancing, routing, and quality-of-service controls.
• Lead technical design discussions, mentor other engineers, and establish best practices for operating large-scale infrastructure.
• Drive network optimization inside and outside data centers, including cost reduction, performance tuning, and removal of scaling bottlenecks.
• Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Envoy, and Istio to strengthen platform capabilities and reliability.
• Own systems end to end, from design through deployment and observability, emphasizing high availability, disaster recovery, and operational excellence.
• Develop and maintain monitoring, alerting, logging, and tracing to provide insight into system health and performance.

Benefits

• Work on challenging AI infrastructure problems, including low-latency inference and scalable model serving.
• Work with advanced technology that affects how businesses and developers use AI globally.
• Ownership and impact in a fast-growing team, with work that directly shapes the future of AI.
• Collaborate with engineers and AI researchers.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior