Data Platform Engineer

Aurora Innovation•Pittsburgh, PA

About The Position

Aurora hires talented people with diverse backgrounds who are ready to help build a transportation ecosystem that will make our roads safer, get crucial goods where they need to go, and make mobility more efficient and accessible for all. We’re searching for a software engineer to join Aurora’s Data Platform. The Data Platform Team is responsible for offloading, ingesting and scaling data through various pipelines, including autonomy sensor data, vehicle logs, sims, models, and training sets, along with their life cycle management. The ideal candidate will design and implement systems that efficiently work for both physical offloaders and cloud, and also be an effective liaison between onboard system to cloud system. In this role, you will Contribute to the development of internal products and following best practices to simplify data retention. Work on tasks to improve the log data availability, discoverability and end to end lifecycle. Design efficient AV Log storage patterns that balance performance and affordability. Help drive the system efficiency by improving data hygiene across Aurora to deliver cost efficiency. Support software engineers across different teams and proactively working together with stakeholders on tasks to satisfy company OKR.

Requirements

BS/MS or PhD in Computer Science or a related field
Minimum 1 year related experience
Required programming skills: GoLang/Python
General knowledge of backend software systems networking, load balancing, API gateways, system security, gRPC services.
AWS infrastructure experience, including S3 and DynamoDB in a production commercial system
Knowledge of database design, database management and database scalability.

Nice To Haves

Proficiencies with coding in C++
Proficiencies with Linux system
Experience with large scale distributed systems or microservice architectures
Experience with DynamoDB / AWS Glue Catalog / AWS Athena
A passion for writing robust, intuitive, high-performance code, and being pragmatic about it
Ability to navigate and work efficiently in large codebase
Strong software development background demonstrated by industry experience in building platforms that serve AV development and commercialization.

Responsibilities

Contribute to the development of internal products and following best practices to simplify data retention.
Work on tasks to improve the log data availability, discoverability and end to end lifecycle.
Design efficient AV Log storage patterns that balance performance and affordability.
Help drive the system efficiency by improving data hygiene across Aurora to deliver cost efficiency.
Support software engineers across different teams and proactively working together with stakeholders on tasks to satisfy company OKR.