Software Engineer, Ingestion Platform

2d•$164,200 - $229,900

About The Position

The Data Platform team is hiring a Software Engineer for its Ingestion Platform team. Reddit’s community generates more than 100 billion events per day, which are ingested into a data warehouse that handles over 55,000 daily queries. This data supports batch and streaming machine-learning and business-intelligence workloads. The Ingestion Platform helps the business process data and orchestrate workloads efficiently, supporting critical teams including Ads, Feed Generation, and ML Experimentation. The engineer will work with teammates and partner teams to create and improve scalable, fault-tolerant, self-service systems for distributed data movement across streaming and batch workloads. The work includes evolving the platform’s control plane and data plane, expanding supported destinations and capabilities, improving connectors and user experience, and migrating legacy ingestion systems. The role also contributes to reliability, security, and operational practices for pipelines running across Kubernetes clusters, and to platform architecture improvements that support Reddit’s growth.

Requirements

At least 2 years of software engineering experience in a production setting writing clean, maintainable, and well-tested code.
Proficiency in an object-oriented programming language such as Python, Scala, Go, or Java.
Demonstrated expertise designing and implementing large-scale systems.
Ability to monitor project progress diligently and demonstrate proactive, self-starting leadership on diverse projects.
Excellent communication skills for collaboration within a service-oriented team and across the broader organization.

Nice To Haves

Experience with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink, and/or modern cloud-based infrastructure.

Responsibilities

Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, focusing on availability, scalability, latency, correctness, and cost efficiency.
Contribute to the architecture and evolution of the platform’s control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations.
Expand the platform beyond Kafka-to-BigQuery, including production-ready paths to S3/GCS and Apache Iceberg, transformations, deduplication, dead-letter queues, and other reusable capabilities.
Build high-quality connectors and abstractions for Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores, keeping the platform modular and extensible.
Improve the self-service experience through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting.
Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering with teams such as Ads Data Platform and ML Indexing to make migrations safe, incremental, and low-touch.
Establish reliability, security, and operational practices for pipelines across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response.
Identify platform architecture and product-experience gaps, and lead redesigns that improve developer velocity and support Reddit’s growth.
Collaborate with engineers and stakeholders across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions.

Benefits

Comprehensive healthcare benefits and income replacement programs.
401(k) with employer match.
Global benefit programs for workspace, professional development, and caregiving support.
Family planning support.
Gender-affirming care.
Mental health and coaching benefits.
Flexible vacation and paid volunteer time off.
Generous paid parental leave.
Medical, dental, and vision insurance for U.S.-based employees.
Equity in the form of restricted stock units; depending on the position offered, commission may also be available.