Staff Software Engineer, Data Warehouse Compute
About The Position
Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Data represents the voice of Airbnb’s users at scale. The Data Warehouse Infrastructure team is responsible for the foundational big data infrastructure, which is used by hundreds of engineers to collect, manage, and analyze data at scale. We are using open source technologies like Hadoop, Spark, Trino, Iceberg, Airflow etc. A Typical Day: Design and build the next generation big data compute platform to empower data ETL, analytics and machine learning at Airbnb Operate, manage and improve the reliability, performance, observability and cost efficiency of the platform. Write maintainable and self-documenting code, perform code reviews. Work on, and contribute to open source software, and have industry impact.
Requirements
- BS/MS/PhD in Computer Science, a related field, or equivalent work experience preferred.
- 10+ years of experience working with data infrastructure, with a focus on big data technologies.
- Proficiency in big data technologies such as Hadoop, Yarn, Spark, Presto/ Trino, Hive, and AWS EMR.
- Strong programming skills in languages such as Java, Scala.
- Extensive experience in designing, building, and maintaining scalable, fault-tolerant distributed systems.
- Demonstrated expertise in multi-threading and concurrency programming.
- Familiar with database systems, both SQL and NoSQL.
- Proven ability to collaborate with other teams to define system requirements, identify potential solutions, and test and integrate systems.
- Capacity to troubleshoot and resolve complex data infrastructure problems.
- Strong communication skills, both written and verbal.
- Ability to work effectively in a team environment.
Responsibilities
- Design and build the next generation big data compute platform to empower data ETL, analytics and machine learning at Airbnb
- Operate, manage and improve the reliability, performance, observability and cost efficiency of the platform.
- Write maintainable and self-documenting code, perform code reviews.
- Work on, and contribute to open source software, and have industry impact.
Benefits
- This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
5,001-10,000 employees
