Test Operations Research Analyst III - Project Based

Autonomous Solutions

About The Position

As a Test Operations Research Analyst, you are responsible for using advanced analytical and mathematical methods to optimize the design of experiments and data collection plans needed to verify and validate ASI's robot systems. You will shape test plans, test suites, and test cases to find statistical efficiencies; work with an agile test team to execute manual and automated tests; lead and organize robot system, instrumentation, and human data collection efforts; analyze data for trends and key metrics; ensure adequate statistical proof and traceability of tests for requirements fulfilment and functional safety certification; and report test findings to help ASI understand system capabilities, readiness, risks, and mitigations. You will help test everything from individual components to fully integrated, autonomous robot systems for a variety of industries.

Requirements

All Level 2 requirements
7-10 years of experience in a technical analysis, operations research, or appropriate test role, preferably with complex robotic systems and robust data collection plans

Nice To Haves

Master's degree or PhD in Operations Research, Mathematics, Statistics, or another relevant discipline
Prior experience with robotics or autonomous systems
Familiarity with common robotics tools and libraries (ROS/ROS2, etc.)
Experience with hardware-in-the-loop (HIL)/software-in-the-loop (SIL) testing and/or simulation environments (Gazebo, etc.)
Understanding of embedded systems, microcontrollers, and communication protocols (CAN, I2C, SPI, etc.)

Responsibilities

Collaborate with program and engineering teams, industry experts, and test team members to understand the concept of operations (CONOP), planned use cases, and design test and data collection plans to assess engineering and customer requirements
Develop and implement mathematically and statistically sound tests, experiments, models, and simulations to predict robot system performance, reliability, and potential failure points during test and fielding
Design end-to-end data collection plans to incorporate and measure relevant data from robot systems, instrumentation, development teams, testers, and end users for the lifecycle of the system; oversee the daily collection, collation, and analysis of meta, instrumentation, and human data
Analyze large datasets from tests to derive insights on system performance, identify trends, and establish key performance indicators (KPIs) and metrics (Mean Time To Intervention, percentage of autonomy, etc.); ensure test results meet exit criteria and provide prioritized, data-driven recommendations to design and development teams
Identify, define, procure, calibrate, and manage test instrumentation and requirements; help define test track requirements and architect custom test fixtures, instrumentation, and hardware-in-the-loop/software-in-the-loop (HIL/SIL) systems to simulate real-world conditions and deliver needed test results
Design, develop, organize, prioritize, and execute comprehensive test plans, test suites, test cases, and data collection plans for the full lifecycle of the robot system, including hardware, software, and integrated systems
Work with SDETs and other test team members to create and maintain scalable test automation frameworks using scripting languages like Python or C++ to improve efficiency, reliability, durability, and other automated test coverage
Work with Mechatronic and Software Quality Assurance team members to perform hands-on testing and debugging of embedded and system-level mechanical, electrical, software, and communications systems on prototype and production systems, including embedded firmware and Mobius command and control software
Work with engineering teams, test teams, and end users to determine appropriate measures and metrics; implement integrated autonomous and human-in-the-loop data collection plans; analyze and post-process test data to identify success criteria, trends, root causes of failures/bugs
Work closely with test, system, software, mechatronic, reliability, and other engineers, technical writers, technical trainers, and more to understand system requirements and align development, test, and fielding activities
Author data collection plans; organize and document findings and results; track issues and results to requirements; and author detailed analysis and test reports