Observability Engineer
About The Position
Bright Vision Technologies is seeking an Observability Engineer to design and operate metrics, logging, tracing, and alerting platforms that help engineering teams operate their systems confidently. The role spans the observability stack, from collection agents and pipelines through long-term storage, dashboards, and alerting workflows, with an emphasis on usability, signal quality, and operational return on investment. The engineer will apply experience building and operating observability platforms at scale, assess trade-offs between open-source and SaaS solutions, and turn telemetry into actionable insight for technical teams and business stakeholders. This is a full-time, direct W2 position that is 100% remote within the United States. The stated salary range is $100,000–$160,000 annually. The posting lists 12+ years of experience in its position details, while the required qualifications call for ten or more years in SRE, platform engineering, or observability roles. Candidates must have a bachelor's degree in Computer Science or a related field. The company is unable to sponsor new H-1B visa petitions; U.S. citizens, Green Card holders, EAD holders, and H-1B transfer candidates are encouraged to apply.
Requirements
- Bachelor’s degree in Computer Science or a related field.
- Ten or more years of experience in SRE, platform engineering, or observability roles; the position details separately state 12+ years of experience.
- Deep hands-on experience with Prometheus, Grafana, and at least one major commercial observability platform such as Datadog, New Relic, or Splunk.
- Strong understanding of OpenTelemetry, distributed tracing, and structured logging.
- Proficiency in at least one general-purpose programming language such as Go, Python, or Java.
- Experience operating high-cardinality, high-throughput metrics and log pipelines.
- Strong understanding of SLOs, error budgets, and SRE principles.
- Experience integrating observability with CI/CD and incident management tooling.
- Solid grasp of Linux internals, networking, and container platforms.
- Excellent communication and collaboration skills.
Nice To Haves
- Experience with Thanos, Mimir, Cortex, Loki, or Tempo at scale.
- Contributions to OpenTelemetry or observability open-source projects.
- Familiarity with eBPF-based observability tooling.
- Experience driving observability cost optimization initiatives.
- Exposure to regulated environments with audit-grade logging requirements.
Responsibilities
- Design and operate enterprise-grade observability platforms for metrics, logs, traces, events, and synthetic monitoring.
- Architect Prometheus, Thanos, Mimir, Grafana, Loki, Tempo, OpenTelemetry, and Datadog deployments for high availability and scale.
- Develop service instrumentation standards, including OpenTelemetry adoption, metric naming, label cardinality, and structured logging conventions.
- Define and enforce SLOs, SLIs, and error budgets, and create dashboards and alerts to operationalize them.
- Build alerting strategies that minimize noise, surface actionable signals, and integrate with on-call workflows and tools such as PagerDuty or Opsgenie.
- Operate large-scale time-series and log storage platforms while balancing retention, query performance, and cost.
- Design distributed tracing pipelines and help teams use traces to diagnose latency and reliability issues.
- Develop self-service tooling, paved-road libraries, and templates to ease product teams' adoption of observability standards.
- Manage costs and enforce label-cardinality discipline across the observability estate.
- Improve incident-response readiness through better dashboards, alerting hygiene, and post-incident analysis tooling.
- Partner with SRE and platform teams to integrate observability into deployment pipelines, canary analysis, and progressive delivery workflows.
- Evaluate and recommend observability vendors and open-source tools based on cost, capability, and operational maturity.
- Mentor engineering teams on observability fundamentals, debugging techniques, and SLO-driven operations.
- Maintain platform documentation, onboarding guides, and runbooks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
