Backend Engineer, Data Platform
About The Position
Software powers the world, and LaunchDarkly empowers all teams to deliver and control the best software. As a Data Platform Engineer, you will help us build batch and stream processing pipelines that process trillions of events per day and deliver data to optimized derived tables that power all major internal and external products built on event data. Our platform serves over twenty trillion feature flags daily. To accommodate the large scale of our systems, we use state-of-the-art pipeline technologies in the AWS ecosystem, including Kinesis, Airflow, Spark, Lambda, Flink and Athena. We store data in databases including Clickhouse, Postgres, ElasticSearch, Timestream and Snowflake. As part of our you-build-it-you-run-it culture, all engineers support the pipelines in production, including in an on-call rotation.
Requirements
- 5+ Years of backend software engineering experience
- Minimum of 1 year experience building product focused Data Pipelines or Data Warehouse
- Demonstrable experience with data pipelines, including some of Kinesis, Airflow, Spark, Lambda, Flink and Athena.
- Experience with event or analytical data sets in databases including some of Clickhouse, Postgres, ElasticSearch, Timestream and Snowflake.
- Familiarity with computer science fundamentals such as data structures, distributed systems, concurrency, and threading
- A commitment to working in a communicative and collaborative environment
- You write code that can be easily understood by others, with an eye towards maintainability
- You hold yourself and others to a high bar when working with production systems
- You value high code quality, automated testing, and other engineering best practices
- Familiarity with Infrastructure-as-Code tools like Terraform or equivalent
- Familiarity with observability tools like Datadog or equivalent
Responsibilities
- Build and expand our data pipelines and data products supporting Experimentation, Release observability, Metrics, Product Analytics and Flag Insights product lines, as well as internal Business Intelligence.
- Collaborate with frontend engineers, product managers and UX designers to deliver user-facing features
- Monitor and improve database and pipeline performance
- Write unit, integration, and load tests as necessary
- Actively participate in code reviews
- Write and review technical proposals
- Improve engineering standards, tooling, and processes
Benefits
- Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
501-1,000 employees
