Staff Software Engineer, Agent Harnessing

Scout AI • Sunnyvale, CA

17h

About The Position

As a Staff Software Engineer on the Agent Harnessing team at Scout AI, you will build the core architecture that enables AI agents to interact with and control complex, real-world physical systems. The work spans agent orchestration, tool integration, low-latency communication layers, and execution environments designed as a platform that Scout AI engineers can extend and depend on. You will help develop Fury, Scout AI’s robotic foundation model for defense, which enables human operators to command fleets of robots through natural language and allows machines to sense, decide, and act together.

Requirements

• 10+ years of full-stack engineering experience.
• Experience building complex agentic products or infrastructure, such as agent loops, orchestration systems, or tool-use frameworks.
• Strong opinions on model and agent behavior.
• Systems-oriented full-stack engineering experience integrating software with physical hardware or low-level systems.
• Strong software engineering fundamentals in architecture, distributed systems, and real-time pipelines, with an ability to ship production systems.
• Must be a U.S. Person due to required access to U.S. export-controlled information or facilities.
• Passion for the defense of the United States and its allies.

Nice To Haves

• Experience in a startup or other high-ownership environment.
• Exposure to simulation environments, game engines such as Unreal, Unity, or Isaac Sim, or robotics middleware such as ROS/ROS2.

Responsibilities

• Design and advance the agent harness—including the agent loop, tools, prompts, execution environment, and capabilities—used across Scout AI’s agentic stack.
• Integrate full-stack software with physical hardware systems and AI agents, ensuring robust, low-latency communication across complex pipelines.
• Build simulation environments and video-game-like frameworks that allow agents to be tested and trained before physical deployment.
• Own the connectors between AI models and real-world systems, translating model output into physical action.
• Fine-tune frontier AI models and build data acquisition pipelines that feed the training infrastructure powering the agents.
• Work closely with warfighters to turn capability requests into production-ready agentic systems.

Benefits

• Competitive cash compensation.
• Meaningful equity.
• Premium medical, dental, and vision plans with $0 paycheck contribution.
• Competitive PTO and a company holiday calendar.
• Catered lunch daily and a fully stocked kitchen.
• EV charging.
• Relocation assistance, depending on role eligibility.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed