Software Engineer, Ingestion Platform
About The Position
Reddit is seeking a Software Engineer for its Data Movement team, focused on solving large-scale data platform and efficiency challenges. This role involves refining and maintaining data infrastructure technologies to support ML and analytics workflows, owning the Data Movement Platform for batch and stream data processing, and investing in new infrastructure for technologies like Spark, Flink, and Airflow. The engineer will build automated solutions for data users, contribute to the open-source community, and collaborate with teammates on on-call responsibilities and monitoring to enhance the reliability, scalability, latency, and efficiency of Reddit’s Data Platform. This position is ideal for someone passionate about building high-quality code, improving company-level strategic decisions, and applying engineering best practices to a vast dataset.
Requirements
- 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
- Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
- Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects.
- Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure.
- Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context.
Responsibilities
- Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users.
- Own the Data Movement Platform used to enable batch and stream data processing at Reddit.
- Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed.
- Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data.
- Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit’s Data Platform.
Benefits
- Comprehensive Healthcare Benefits and Income Replacement Programs
- 401k with Employer Match
- Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
- Family Planning Support
- Gender-Affirming Care
- Mental Health & Coaching Benefits
- Flexible Vacation & Paid Volunteer Time Off
- Generous Paid Parental Leave
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
