Senior Software Engineer, Data Platform

Motional•Boston, MA

12d

About The Position

The Data Platform team is the vital link between our company's expansive data and the engineering teams that rely on it. We architect and operate the core services and infrastructure necessary to transform petabytes of raw data each month into actionable insights for our Machine Learning and Autonomy engineers. This role is a key contributor across our core initiatives: Data Processing : We are building state-of-the-art infrastructure to meet the demands of our rapidly scaling fleet and sophisticated ML engineering requirements. You will be responsible for ensuring that our core data pipelines are robustly engineered—meaning they are performant, user-friendly, and highly fault-tolerant. Data Discovery : we are building a platform that combines cataloging data for search needs across our metadata stores, vector datastores, and various data warehouses to super charge our ML pipelines. You would be coming in and working with ML and autonomy stakeholders to build out this new discovery platform. Data Lineage : we are getting started with building our data lineage system that will track the usage of all data at Motional. You would work with our stakeholders to ensure our system is widely adopted and address customer pain points.

Requirements

3+ years of professional experience as a data engineer or data pipeline engineer
BS or MS in Computer Science or related field
Strong development experience with Python and SQL.
Expertise with AWS services and solutions (EKS, Lambda, ETL)
Experience with distributed system design and development
Comfortable working in a fast-paced, continuous delivery environment

Nice To Haves

Experience with Infrastructure Monitoring
Experience working in cross-functional development teams

Responsibilities

Play a key role in designing and building the next generation of data infrastructure.
Build scalable backend services for data discovery and data lineage systems.
Write high quality, maintainable code to process petabytes of data
Lead and champion high-level system design and quality code reviews/technical contributions.
Design, build, and maintain scalable data processing and access with cloud ETL technology.