Evaluation Systems Engineer, Autonomous Vehicles

GM • Sunnyvale, CA

9h • Hybrid

About The Position

You will be part of a team that driv es systematic and data-driven improvements to the Autonomous Vehicle sof twa re by designing, implementing, and maintaining robust processes for evaluation and validation of our AVs . To achieve this objective , we are looking for a highly motivated individual with excellent analytical skills to own end to end execution, methodology improvements and insight articulation/communication to ensure hig h -qual ity evaluation and release of our End-to-End ML Stack . In this position, you will work closely with AI/ML Engineers, Simulation Engineers , Systems Engineers, Product Managers to identify , analyze, monitor and prioritize the most important s ignals to assess performance of our ML based stack leveraging simulation and on-road data and building scalable processes to evaluate compliance to our KPIs . If you're interested in having a major impact on accelerating AV Behavioral Evaluation assessment on ML-driven autonomy through creative problem solving, let's chat!

Requirements

• Strong Python and SQL programming
• Prio r knowledge and implementation of ELT pipelines for product quality analysis
• Strong problem-solving skills - End to End ownership from problem definition to deriving the desired outcome
• Passionate about robotics/AI complexities
• Proven track record of analytical and systems engineering skills while dealing with complex systems and ambiguous AI functions
• Proven track record of root cause analysis in complex SW/HW systems
• Familiarity with analytical methods for driving behavioral analysis
• Ability to creatively problem solve with limited supervision
• Motivated by a fast paced, challenging environment with high expectations and quick turnarounds
• Strong cross functional communication and collaboration skills
• Ability to learn quickly, starting with little information and quickly becoming an expert in your domain
• Proven experience at communicating data driven decisions to leadership
• BS , MS or PhD in Engineering or related discipline or equivalent combination education and experience

Nice To Haves

• Experience with statistical methods for product evaluation and risk assessment
• Experience with developing data driven metrics
• Experience with GitHub and Jira or equivalent tools
• Experience with robotics and AV/ADAS systems

Responsibilities

• Define an AV evaluation process that spans from initial conception through implementation, ensuring it is applied to the release of our end-to-end (E2E) ML s tack.
• Provide hands-on implementation of infrastructure solutions t o assess AV performance from E LT tooling at GM from simulation and on-road data .
• Proactively scope and identify metrics needed to imp rove our evaluation workflows and devise paths for implementation if not available .
• Contribute to automated triage strategies for AV deficiencies in an End-to- E nd sta ck architecture and p resent findings to rele vant stakeholders.
• Articulate insights, summaries and recommendations to AV developers and executives based on continuous analysis of AV performance .
• Define and maintain scalable processes to identify , monitor and improve evaluation KPIs as definition of success of evaluation initiatives .
• Map and articulate link between continuous improvement processes with the product s afety case and compliance with safety standards .

Benefits

• An incentive pay program offers payouts based on company performance, job level, and individual performance.
• This job may be eligible for relocation benefits.
• From day one, we're looking out for your well-being–at work and at home–so you can focus on realizing your ambitions.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level