Senior Software Engineer I , Observability

Etsy•Brooklyn, NY

1d•Hybrid

About The Position

Etsy is seeking a Senior Software Engineer I to build and support its observability platform for distributed systems. The engineer will help develop the telemetry stack, which includes Prometheus, Grafana, BigQuery, StatsD, Vector, Google Cloud Logging, and Honeycomb, and contribute to the architecture for systems running across virtual machines and containers. This role is part of a strategic team working to improve visibility, reliability, and observability as Etsy's platform evolves. The Observability team builds tools and services to collect, store, and analyze telemetry data, helping engineers detect, diagnose, and resolve issues. The role involves working with large and rapidly growing volumes of logs, metrics, and traces; designing reliable systems that support a 99.95% availability goal; and creating developer tooling that helps Etsy engineers understand and improve infrastructure reliability. The engineer will work across the infrastructure stack and collaborate with teams throughout Etsy Engineering to understand business needs and system impacts. This is a full-time role reporting to the Engineering Manager for Observability. Candidates are prioritized within commuting distance of Etsy's Brooklyn office, with in-office attendance once or twice per week depending on proximity. Remote candidates outside commuting distance may be considered case by case and should expect occasional office travel.

Requirements

Experienced software engineer, with the last 3 years in observability systems or developer tooling roles; cloud environment experience is preferred.
Prior experience executing multiple large, successful projects in a team environment, including projects that took many months or longer.
Professional experience implementing or actively using metrics, logging, and tracing systems.
Proficiency in at least one programming language such as PHP, Python, or Go.
Hands-on experience with infrastructure-as-code tooling such as Terraform and configuration-management tooling such as Chef or Ansible.
Ability to independently solve well-scoped problems within guidelines set by teammates.
Strong communication skills and ability to work effectively with others.
Willingness to work with and improve code that the candidate did not originally write.

Nice To Haves

Experience with cloud architectures such as GCP or AWS.
Exposure to Kubernetes or other container orchestration frameworks.
Experience working with flexible, distributed teams.

Responsibilities

Build and support Etsy's telemetry and observability stack.
Design reliable systems that enable customers to achieve 99.95% availability.
Create and maintain developer tools that improve observability and help engineers deploy and understand infrastructure reliability.
Work with large and rapidly growing volumes of logs, metrics, and traces.
Design, develop, and implement scalable, maintainable systems across all levels of the infrastructure stack.
Work with engineering teams across Etsy to understand their telemetry needs, business requirements, and upstream and downstream impacts.
Collaborate with developers on instrumentation best practices and help improve issue prevention, detection, diagnosis, and resolution.
Independently tackle well-scoped problems within team guidelines and improve existing code and systems.