Software Engineer, Data Ingestion Systems

Wayve • Sunnyvale, CA

6d • $209,700 - $266,800 • Hybrid

About The Position

Our Ingestion Systems team sits within Wayve’s AI Platform organisation and builds the data foundations behind our self-driving technology. We process vast amounts of real-world driving data so it can be used for annotation, model training and evaluation. Operating at petabyte scale, the team focuses on making these critical data flows reliable, efficient and easy to operate.

Requirements

• Strong production experience with Apache Spark and Python.
• Built, operated or debugged large-scale ingestion, ETL or distributed data-processing pipelines.
• Comfortable diagnosing production failures involving corrupt data, stalled queues, retries and complex dependencies.
• Understand how to optimise high-throughput systems for reliability, performance and cost.
• Can learn an existing system quickly, work independently and deliver practical improvements in a fast-moving environment.

Nice To Haves

• Experience with Airflow, Flyte, Databricks, Delta Lake, Scala or Java.

Responsibilities

• Debug and unblock failing ingestion pipelines, stalled jobs and processing queues.
• Investigate corrupt, malformed or unexpected data from a variety of sources.
• Optimise Spark jobs and batch-processing pipelines for throughput, reliability and compute efficiency.
• Work alongside permanent engineers to prioritise critical datasets and reduce operational toil.
• Improve monitoring, retries and failure recovery across multi-step ingestion workflows.

Benefits

• Salaries benchmarked against the market annually
• Meaningful equity, sharing in the ownership and long term success of Wayve
• Relocation support and visa sponsorship where applicable
• Hybrid working, core hours and the chance to work hands on in vehicle workshops and labs
• Learning and development budgets with support for training, conferences and growth
• Comprehensive benefits including health insurance, dental, enhanced maternity and paternity leave, retirement or pension where applicable, access to therapists, wellbeing partnerships, team socials and more

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed