Staff Software Engineer, Data Infrastructure
RapidAPI
·
Posted:
August 28, 2023
·
Remote
About the position
We are seeking a Staff Software Engineer to join our team at Runway. In this role, you will be responsible for building scalable and robust data infrastructure to support our applied research. You will be the first hire in a new team focused on developing data pipelines for generative model training and continuous model improvement. The ideal candidate will have experience in building large-scale systems for data analysis and retrieval, as well as strong system design and collaboration skills. If you are passionate about pushing the boundaries of creativity and making professional video and content creation accessible to all, we would love to hear from you.
Responsibilities
- Build out pipelines for the creation, curation, and processing of large-scale multimodal datasets
- Create internal tooling to enable Runway's applied research team to build workflows and run experiments on that infrastructure
- Strong knowledge of Python
- Experience with one or more frameworks for large-scale data processing (e.g. Spark, Ray, etc) and one or more ML frameworks (e.g. PyTorch, JAX)
- Experience building out data pipelines from scratch and optimizing those pipelines for high performance and great developer experience
- Familiarity and experience with AWS and/or GCP is a bonus
Requirements
- Strong knowledge of Python
- Experience with one or more frameworks for large-scale data processing (e.g. Spark, Ray, etc) and one or more ML frameworks (e.g. PyTorch, JAX)
- Experience building out data pipelines from scratch and optimizing those pipelines for high performance and great developer experience
- Familiarity and experience with AWS and/or GCP is a bonus
Benefits
- Competitive salary range of $220,000-260,000
- Opportunity to work with a small and growing team of diverse individuals
- Focus on building scalable and robust data infrastructure
- Chance to contribute to Runway's mission of making professional video and content creation accessible to all
- Access to top-tier investors and partners including Google, NVIDIA, and Salesforce
- Opportunity to work with cutting-edge technologies such as computer graphics, web, and machine learning
- Chance to build pipelines for creation, curation, and processing of large-scale multimodal datasets
- Ability to create internal tooling for applied research team workflows and experiments
- Strong emphasis on collaboration and system design skills
- Familiarity and experience with AWS and/or GCP is a bonus
- Commitment to diversity and equal opportunity for all employees
- Recognition as a best place to work by Crain's, InHerSight, BuiltIn NYC, and INC