Software Engineer II, Observability

Etsy•New York, NY

1d•$124,000 - $186,000•Hybrid

About The Position

We are looking for an engineer with a strong background (or interest) in building observability platforms for distributed systems. As the Software Engineer II, SRE (for Observability) you will be building and supporting our telemetry stack which consists of Prometheus, Grafana, BigQuery, StatsD, Vector, Google Cloud Logging, and Honeycomb. We have an ambitious roadmap to improve visibility of services and infrastructure running across VMs and Containers, and continue to develop in an ai-centric world. As a team, we are a strategic advantage for Etsy by building the future of observability. You will be playing an instrumental role in crafting the future architecture of how we run our systems in the cloud while being part of a dynamic international team. This is a full time role reporting to the Engineering Manager for Observability.

Requirements

Strong background (or interest) in building observability platforms for distributed systems.
Last 2 years in Observability systems/developer tooling roles, preferably in a cloud environment.
Prior experience in executing multiple large, successful projects within a team environment.
Prior experience in either implementing or actively using metrics, logging and tracing systems in a professional setup is essential.
Proficiency in one of the programming languages like PHP, Python, Go is essential.
Hands-on experience with Infrastructure As Code tooling like Terraform and configuration management tooling like Chef/Ansible is essential.
Understanding that being an effective software engineer is as much about communicating with people as it is about writing code.

Nice To Haves

Experience with cloud architectures (GCP, AWS), and exposure to Kubernetes or other container orchestration frameworks is nice to have.
Experience working with flexible, distributed teams is a big plus.

Responsibilities

Building and supporting our telemetry stack which consists of Prometheus, Grafana, BigQuery, StatsD, Vector, Google Cloud Logging, and Honeycomb.
Improving visibility of services and infrastructure running across VMs and Containers.
Developing in an ai-centric world.
Crafting the future architecture of how we run our systems in the cloud.
Building tools and services to collect, store and analyze telemetry data.
Optimizing for time to detect, diagnose and resolve issues.
Working closely with developers on best practices for instrumentation.
Creating and maintaining an observability suite of tools that enable engineers to deploy 100+ times every week and gather deep insights on the infrastructure’s reliability.
Working closely with other teams to support their telemetry needs.
Working with an extensive amount of telemetry (Petabytes of logs, millions of metrics, and traces) that is growing rapidly.
Designing systems that operate reliably enabling our customers to hit 99.95% availability.
Building best-in-class developer tooling by keeping Observability human.
Understanding and solving real business needs at a large scale by applying software engineering and analytical problem-solving skills.
Working with the Engineering Team at large to gain a deep understanding of Etsy Engineering, i.e. security, product engineering, risk, database infrastructure teams, and understand up/downstream impacts.
Designing, developing and implementing highly scalable and maintainable systems by contributing at all levels of our infrastructure stack using technologies like Chef, Terraform, Kubernetes, GoLang, Prometheus, Envoy, OTel.
Tackling well-scoped problems independently within guidelines set by teammates.
Working with and improving on code not originally written.