Senior Software Engineer, Data Infrastructure

Roberts Recruiting • Cambridge, MA

4d

About The Position

The Data Infrastructure teams are responsible for building and maintaining data storage technologies across the product. Teams work with a variety of open source technologies like MySQL, Vitess, Hadoop HBase, Kafka, Spark, and Elastic Search all running on AWS. One of the primary objectives is to automate the deployments, configuration, and recoverability of data stores to efficiently scale storage systems. Teams also take on projects to improve the client-side interaction with the data stores with analysis tools and wrapper client interfaces. A number of our teams are active contributors to the Open Source projects that they work on. We’re operationally responsible for a huge volume of traffic to and from these data stores. Our HBase clusters serve over 3 million requests/second across 220+ tables, while our ElasticSearch clusters serve over 20k searches/second and 50k indexes/second to 90+ billion documents. Streaming that data to and from applications amounts to more than 3 GB/sec of data through our Kafka clusters, with hundreds of producers and consumers. What we’re looking for We’re looking for talented software engineers to help us build the vision of making our database access simple, intuitive, highly performant and highly reliable to our customers and ohapplication developers. The goal of the team is to implement a comprehensive set of intelligent features that will drive the productivity of using any of our data stores at scale and with the highest possible reliability.

Requirements

• Talented software engineer
• Ability to work with developers to define and build tools
• Interest in working with and supporting infrastructure at scale
• Ability to solve complicated technical problems
• Ability to analyze tradeoffs with empathy for developers
• Ability to build creative solutions
• Pragmatic decision making and problem-solving abilities

Nice To Haves

• Experience developing automation
• Power user of one or more of the following technologies: MySQL, Vitess, Hadoop HBase, Kafka, Spark, Elastic Search

Responsibilities

• Building and maintaining data storage technologies
• Automating the deployments, configuration, and recoverability of data stores
• Improving client-side interaction with data stores through analysis tools and wrapper client interfaces
• Contributing to Open Source projects
• Implementing intelligent features to enhance the productivity and reliability of data store usage at scale

Benefits

• Flexibility
• Autonomy
• Transparency

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed