Senior Software Engineer, Data Ingestion - Autonomous Vehicles

NVIDIA•Santa Clara, WA

1d•$184,000 - $356,500

About The Position

NVIDIA is hiring a Senior Software Engineer to work on improving the data ingestion platform in our Autonomous Vehicles division! As a Data Ingestion engineer for Autonomous Vehicles Infrastructure, you will play a crucial role in managing and optimizing the flow of data from various sources into our AV systems. Your primary focus will be on ensuring the seamless ingestion and efficient serving of AV data to support critical operations.

Requirements

Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
8+ years of relevant experience working on autonomous vehicles and/or software infrastructure.
Extensive expertise in developing distributed systems.
Proven experience in designing and building data ingestion pipelines for large-scale systems.
Strong proficiency in data warehousing concepts, data modeling, and database management systems.
Proficient in Go, C++ and have experience with scripting languages such as Python or Matlab in a Linux environment
Familiarity with distributed computing frameworks like Apache Spark or Hadoop.
Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.

Nice To Haves

Hands-on experience with data streaming technologies (e.g., Kafka, RabbitMQ) is a plus.
Knowledge of cloud-based platforms (AWS, GCP, or Azure) and containerization (Docker/Kubernetes).

Responsibilities

Implement and maintain data ingestion pipelines from diverse sources, ensuring a continuous and reliable flow of AV data into the system.
Design and optimize data serving mechanisms to deliver AV data to different teams and applications in real-time and batch processing scenarios.
Monitor data pipelines and services to proactively identify and resolve any issues, ensuring data availability and reliability.
Collaborate with cross-functional teams to improve data processing efficiency, reduce latency, and enhance overall system performance.
Implement validation and data quality checks to ensure the integrity and accuracy of ingested data.
Scale data infrastructure to handle the ever-increasing volumes of AV data generated by our expanding fleet of vehicles.
Create and maintain detailed documentation for data ingestion and serving processes, ensuring knowledge sharing across the team.
Work closely with the AV development team to understand data requirements and contribute to the enhancement of data-driven solutions.