Senior Software Engineer - Infrastructure

Julius AI • San Francisco, CA

3d

About The Position

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in isolated remote containers that we manage. We’re revenue‑generating and backed by AI Grant and founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox. Build and scale the code‑execution platform that powers Julius—across cloud and on‑prem environments. We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

Requirements

• Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
• Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
• Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).
• Security best practices for containerized, multi‑tenant systems.

Nice To Haves

• gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
• Delivered on‑prem or air‑gapped enterprise software.
• You’ve built an AI side project and enjoy tinkering with LLMs.

Responsibilities

• Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.
• Ship on‑prem/private cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.
• Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.
• Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

Benefits

• Health & dental
• gym reimbursement
• daily team lunches
• 401(K)

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed
• Number of Employees: 1-10 employees