Staff Software Engineer, Teleoperation

Agility Robotics•Pittsburgh, PA

3d•Hybrid

About The Position

As a Staff Software Engineer on the AI team, you will architect and build production-quality teleoperation systems that enable Digit to execute complex whole-body manipulation tasks in real-world environments. You will work closely with AI, controls, hardware, and operations teams to create a scalable platform for high-quality human demonstration data collection. Your work will directly enable our ability to scale up the world's first production humanoid robot fleet and revolutionize the labor market.

Requirements

8+ years of experience in robotics or real-time systems, with a demonstrated track record of delivering reliable, production-quality software
Deep understanding of real-time control systems, motion retargeting, and rigid body dynamics
Experience designing low-latency communication and streaming systems for real-time applications
Strong systems intuition with the ability to trace performance issues across software, networking, and hardware boundaries
Strong analytical and debugging skills, with a data-driven approach to performance validation and system reliability
Hands-on experience integrating human input systems such as VR, motion capture, wearable devices, or other operator interfaces
Excellent communication skills and the ability to collaborate effectively across AI, controls, hardware, and operations teams

Nice To Haves

Experience building applications with real-time rendering or XR frameworks such as Unity, Unreal, Godot, SteamVR, or OpenXR
Experience with advanced 3D visualization techniques such as neural radiance fields, Gaussian splatting, or other scene reconstruction methods
Familiarity with large-scale data collection pipelines for learning from demonstration

Responsibilities

Own the end-to-end architecture of the teleoperation system, from operator input through real-time robot execution, ensuring low latency, predictable behavior, and clear system boundaries
Integrate and optimize real-time control, streaming, and communication paths to meet measurable latency and bandwidth targets
Design and implement scalable teleoperation interfaces, including VR, motion capture, and other modalities, to enable high-quality manipulation and locomotion demonstrations
Develop comprehensive validation strategies in simulation and on hardware, including performance benchmarks, fault handling, and regression testing
Analyze teleoperation and demonstration data to improve operator efficiency, system responsiveness, and task success rates
Anticipate future robot hardware and sensor changes, and design systems that can adapt to new interfaces and capabilities with minimal architectural disruption

Benefits

401(k) Plan: Includes a 6% company match.
Equity: Company stock options.
Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees.
Benefit Start Date: Eligible for benefits on your first day of employment.
Well-Being Support: Employee Assistance Program (EAP).
Exempt Employees: Flexible, unlimited PTO and 10 company holidays, including a winter shutdown.
Non-Exempt Employees: 10 vacation days, paid sick leave, and 10 company holidays, including a winter shutdown, annually.
On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations.
Parental Leave: Generous paid parental leave programs.
Work Environment: A culture that supports flexible work arrangements.
Growth Opportunities: Professional development and tuition reimbursement programs.
Relocation Assistance: Provided for eligible roles.
Annual Discretionary Bonus: Provided for eligible roles.