Software Engineer, Evaluation Infrastructure

Waabi • Toronto, ON

91d

About The Position

The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system’s performance across all development stages. In this role, you will work closely with the systems & safety teams, responsible for defining the requirements & evaluation criteria, and simulation teams to leverage Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of the next generation of autonomous vehicles!

Requirements

• MS/Bachelors degree with 2+ years of industry experience in Computer Science, Machine Learning and/or similar technical field(s) of study.
• Proficient in Python programming and strong software engineering fundamentals with real-world experience writing high quality, well-structured, and well-tested code.
• Open-minded and collaborative team player with the willingness to help others.
• Passionate about self-driving technologies, solving hard problems, and creating innovative solutions.

Nice To Haves

• Experience in data processing pipelines, ETL pipelines, distributed computing.
• Experience in building highly reliable and scalable web services
• Understanding of cloud job orchestration, monitoring, and instrumentation best-practices.
• Experience in evaluating complex ML models or self-driving software stacks.

Responsibilities

• Develop the tooling, infrastructure, and pipelines to support complex statistical analyses of driving performance scale.
• Implement metrics and tags to provide a holistic understanding of model performance and enable the discovery of interesting scenarios for training and evaluation.
• Develop and maintain a high availability query service to enable low-latency analysis and curation over large volumes of metric and tag data
• Work with large datasets from various sources including real world driving as well as Waabi World, our high-fidelity simulator.
• Champion engineering excellence, ensuring high-quality, well structured and tested code.
• Assist in project roadmap planning, prioritisation, and delivery.

Benefits

• Competitive compensation and equity awards.
• Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
• Unlimited Vacation.
• Flexible hours and Work from Home support.
• Daily drinks, snacks and catered meals (when in office).
• Regularly scheduled team building activities and social events both on-site, off-site & virtually.
• As we grow, this list continues to evolve!

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 101-250 employees