Staff Software Engineer, Data Platform

Scale AI•San Francisco, CA

3h•$252,000 - $315,000

About The Position

Scale’s Platform Engineering team provides the foundation for its AI data products. As a Staff Software Engineer on the Data Platform team, you will lead the design and development of core data storage, streaming, caching, and indexing platforms and their underlying systems. You will work closely with stakeholders and internal customers to understand and refine requirements, and gain exposure to AI applications across enterprises, startups, governments, and large technology companies.

Requirements

At least 8 years of full-time engineering experience after graduation, specializing in back-end systems and large-scale data storage, streaming, and warehousing systems.
Extensive experience with database technologies such as MongoDB and Postgres; streaming and processing solutions such as Kinesis, Flink, and Spark; indexing and caching technologies such as ElasticSearch and Redis; and data query engines such as Trino, Presto, and Snowflake.
A track record of mentoring and leading teams on successful projects.
Excellent communication and collaboration skills, including the ability to explain complex technical concepts to non-technical stakeholders.
Fluency with containerization and deployment technologies such as Kubernetes and with public cloud offerings.
Extensive software development experience and a deep understanding of distributed systems, cloud platforms, and data systems.
Experience driving cross-functional collaboration and communication at an organizational or broader level.

Nice To Haves

Strong knowledge of software engineering best practices and CI/CD tooling such as CircleCI.
Experience tuning performance and optimizing costs for cloud-based data platforms.
Experience defining data lifecycle strategies and designing or implementing tooling for data privacy requirements such as GDPR.
Experience scaling products at hyper-growth startups.
Excitement about working with AI technologies.

Responsibilities

Drive the architecture, design, implementation, and reliability of foundational data platforms and systems, working with stakeholders and internal customers to understand and refine requirements.
Collaborate with cross-functional teams to define, design, and deliver new features.
Identify and drive improvements to programming practices, processes, and tools.
Present technical information to teams and stakeholders, providing guidance on development processes and technologies.
Provide technical leadership by upholding and improving engineering standards and mentoring junior engineers.