Software Engineer III, Agents Platform

Box•Redwood City, CA

3d•Hybrid

About The Position

AI is transforming how enterprises work, and Box is building an enterprise-grade Agents Platform at the core of the Box Content Cloud. Our platform, built on LangGraph, enables teams across Box and our customers to design, deploy, and operate AI agents that power real-world workflows—from content understanding and generation to intelligent metadata, automation, and complex, multi-step orchestrations. As a Software Engineer III on the Core Agents team, you’ll help build the secure, reliable, and scalable foundation that makes agent development fast and safe. You’ll contribute to services that define agent frameworks and tooling, orchestrate multi-agent workflows, integrate with multiple LLMs and enterprise systems, and uphold tenant isolation, data governance, and least-privilege access. Your work will enable product teams and enterprise customers to build, customize, and operate agents for critical use cases with confidence.

Requirements

3+ years of professional software engineering experience building and operating backend or platform services at scale.
Proficient in an object-oriented language (e.g., Java, C++, C#, Scala) and comfortable with modern service development patterns.
Solid grasp of distributed systems, data structures and algorithms, API design, and platform architecture fundamentals.
Experience building and debugging production systems with strong logging, metrics, tracing, and alerting.
Comfortable owning projects end-to-end: scoping, design, implementation, testing, rollout, and iteration.
Strong collaborator with clear communication skills; able to work cross-functionally with ML, product, and security partners.
Growth mindset with a bias for action; you value clean code, reliability, and incremental delivery.

Nice To Haves

Experience with agent frameworks or orchestration tools (e.g., LangGraph, LangChain) or workflow engines.
Familiarity with LLM concepts (RAG, semantic search, indexing, ranking/relevance) and integrating with cloud ML platforms (Vertex AI, AWS Bedrock, SageMaker).
Exposure to Kubernetes-based systems, service meshes, or containerized workloads.
Experience building SDKs, developer platforms, or internal tooling that accelerates engineering teams.
BS in Computer Science or related field (or equivalent practical experience).

Responsibilities

Design, build, and maintain core components of the Agents Platform that power agentic use cases (e.g., Deep Search, Deep Research).
Implement and evolve agent and tool repositories, SDKs, and developer tooling to streamline agent development, testing, and deployment.
Contribute to a multi-tenant control plane that enforces isolation, fair resource allocation, and per-tenant SLAs across agent workloads.
Develop high-throughput, low-latency services with strong observability, guardrails, and secure execution environments.
Collaborate with ML engineers and partner product teams to translate requirements into scalable capabilities on top of LangGraph.
Improve CI/CD pipelines, automated testing, and reliability practices to boost developer velocity and production quality.
Participate in on-call rotations to support, triage, and resolve production issues, driving root cause analysis and preventive fixes.
Write clear design docs, review code, and contribute to best practices for distributed systems within the AI Platform organization.