Senior/Staff Software Engineer - Perception & Sensing

Zoox•Boston, MA

About The Position

The Perception Sensing team is looking for a Senior or Staff Software Engineer to drive the evaluation and architectural design of our PCP stack for future vehicle platforms enabling winter driving and low cost vehicle platforms. This team acts as the bridge between Perception Software and Autonomous Hardware Engineering (AHE). We ensure that as Zoox evolves toward future platforms, every sensor change across all modalities (Lidar, Radar, Camera etc) is validated with mathematical rigor. The role focuses on executing the technical validation pipeline and experimental design across the entire sensor suite.

Requirements

Strong C++ and Python for running and modifying PCP metrics pipelines, automated testing, and re-simulations.
Experience with A/B testing methodology (RBV - Risk Balanced Verification) for evaluating hardware/software changes in varied environments.
Familiarity with diverse perception outputs and how environmental factors (like snow or fog) degrade bounding box precision/recall, point clouds, and 3D occupancy.
Ability to define complex data collection plans for winter ODDs (e.g., specific snow types, ice, low temperatures).
Experience with designing, developing and deploying multi-modality fusion based Perception models for 3D object detection, 3D segmentation & occupancy, Mapping and Localization.

Nice To Haves

Experience in performance optimization to fit complex ML stack to low-power low cost edge compute (e.g., Nvidia Thor, TensorRT optimization).
Experience with designing better sensor or better ML model for an anomaly or rare event/objects detection

Responsibilities

Execute the PCP metrics pipeline, assessing how hardware updates across various sensors impact PCP performance sensitivity in 3D scene understanding, live mapping and localization, especially in adverse weather and winter conditions.
Design and run structured A/B testing experiments, including side-by-side custom mount runs and tandem vehicle data collection, to clear sensors for the winter ODD.
Collaborate with AHE to correlate sensor-specific lab tests (e.g., heater/defroster impacts on camera lenses, snow accumulation on radomes) to downstream PCP performance.
Root cause detection regressions to understand how early fusion models compensate for modality degradation in challenging environments.
Design & develop performant and efficient multi-sensor fusion model to leverage the complementary advantage of on-board (low cost) sensors to improve Perception performance for highway and adverse weather.