Software Engineer - Infrastructure (Mid - Senior)

Julius AI • San Francisco, CA

1d

About The Position

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes ( isolated remote containers ) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

Requirements

• Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
• Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
• Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).
• Security best practices for containerized, multi‑tenant systems.

Nice To Haves

• gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
• You’ve built an AI side project and enjoy tinkering with LLMs.

Responsibilities

• Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP).
• Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.
• Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.
• Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.
• Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

Benefits

• Health & dental insurance
• Gym reimbursement
• Daily team meals
• Commuter benefits

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed