Software Engineer, Data Ingestion & Transformation
About The Position
Starburst is looking for a Software Engineer to work with our globally distributed engineering team on Starburst's industry-leading data ingestion and transformation platform. In this role, you'll contribute directly to the evolution of Starburst, tackling complex challenges across our managed SaaS, open source, and proprietary offerings - an ideal environment for learning and innovation. As a Software Engineer on our Icehouse team, you'll build highly scalable systems for ingesting and transforming data on Starburst's open data lakehouse. This is a unique opportunity to work at the forefront of data systems built around the open source distributed query engine Trino, and Apache Iceberg.
Requirements
- 3+ years of experience developing software
- Prior experience developing distributed systems
- Extensive software development experience with Java. Experience with other systems programming languages (Rust, C++, Go, etc) can be considered.
- Demonstrated experience with software engineering and design best practices
- Demonstration of ownership, grit, and bias for action - core values at Starburst
- Ability to Travel: This role will require occasional in-person travel for purposes including but not limited to new hire onboarding, team and department offsites, customer engagements, and other company events. Actual travel expectations may vary by role and business needs.
Nice To Haves
- Prior experience with software development using Trino, Apache Iceberg, Apache Kafka, or cloud object storage a huge plus
Responsibilities
- Design, develop and operate systems and features relating to data ingestion and transformation. You'll build on our systems which have proven ingestion up to 100GB/second.
- Work cross functionally to ensure the best experience for our customers.
- Build and implement features for creating and operating data lakes based on Apache Iceberg, such as streaming ingestion from Apache Kafka and Kafka-compatible systems; file ingestion from cloud object storage such as Amazon S3; data transformations; and automated scalable data maintenance.
- Provide considerate and timely review of your peers' design proposals pull requests.
- Help to build a highly effective culture across Starburst and your team.
Benefits
- competitive pay
- attractive stock grants
- flexible paid time off
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Industry
Professional, Scientific, and Technical Services
Education Level
No Education Listed
Number of Employees
501-1,000 employees
