Senior AI Research Engineer

Agility Robotics•Pittsburgh, PA

3h•Hybrid

About The Position

The AI innovation team at Agility works on building and deploying next-generation robot foundation models and end-to-end policies on humanoid robots. Your goal will be to develop and test cutting-edge methods for imitation learning and reinforcement learning on humanoid robots, in order to establish the techniques necessary for humanoid robots to perform different real-world tasks. You will work on a team, running experiments on humanoid robots, and will research and implement methods which can be transferred into production. Design, train, and deploy robust policies for locomotion, manipulation, and dynamic interactions with the environment. Develop core reinforcement learning infrastructure, including scalable training pipelines and evaluation frameworks. Design and implement new simulation environments and tasks to support training and deployment of control policies. Develop, design, and test imitation learning methods. Collaborate with Robotics Software and AI engineering teams to develop policies which can be transferred to production.

Requirements

3+ years of experience developing and deploying learning-from-demonstration
Strong programming skills in Python, with proficiency in deep learning frameworks such as PyTorch
Experience with modern learning-from-demonstration tools like DiffusionPolicy
Experience with robot data collection, training, and testing on hardware to perform manipulation tasks
Ability to work collaboratively in a fast-paced environment to deliver safe, high-quality software
MS in Robotics, Computer Science, or a related field

Nice To Haves

PhD in Robotics, Computer Science, or a related field
Publications in top ML or robotics conferences (e.g. NeurIPS, ICML, CoRL, RSS, ICRA)
Familiarity with robot simulation environments (e.g. Mujoco, Isaac Sim) and sim-to-real transfer techniques
Experience with modern reinforcement learning techniques for locomotion, manipulation, and whole-body control
Experience with writing performant, high quality software in C++

Responsibilities

Develop and test cutting-edge methods for imitation learning and reinforcement learning on humanoid robots, in order to establish the techniques necessary for humanoid robots to perform different real-world tasks
Work on a team, running experiments on humanoid robots
Research and implement methods which can be transferred into production
Design, train, and deploy robust policies for locomotion, manipulation, and dynamic interactions with the environment
Develop core reinforcement learning infrastructure, including scalable training pipelines and evaluation frameworks
Design and implement new simulation environments and tasks to support training and deployment of control policies
Develop, design, and test imitation learning methods
Collaborate with Robotics Software and AI engineering teams to develop policies which can be transferred to production

Benefits

401(k) Plan: Includes a 6% company match
Equity: Company stock options
Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees
Benefit Start Date: Eligible for benefits on your first day of employment
Well-Being Support: Employee Assistance Program (EAP)
Time Off: Exempt Employees: Flexible, unlimited PTO and 10 company holidays, including a winter shutdown. Non-Exempt Employees: 10 vacation days, paid sick leave, and 10 company holidays, including a winter shutdown, annually
On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations
Parental Leave: Generous paid parental leave programs
Work Environment: A culture that supports flexible work arrangements
Growth Opportunities: Professional development and tuition reimbursement programs
Relocation Assistance: Provided for eligible roles
Annual Discretionary Bonus: Provided for eligible roles