Production Support Analyst Sr - Observability

TekWissen•Taylor, TX

8d•Remote

About The Position

TekWissen is seeking a senior Production Support Analyst to support a multi-year observability and monitoring modernization initiative on a temporary, 24-month contract assignment. The role will assess the existing monitoring landscape and assist with onboarding, deploying, and operating the Grafana stack—including Grafana, Loki, Tempo, Mimir/Prometheus, and Alloy—in an enterprise environment. The position is remote and based in the job posting at Taylor, Texas. The analyst will help design and implement observability for metrics, logs, and traces; integrate Grafana with enterprise tools and identity providers; standardize dashboards, alerts, SLIs/SLOs, and notification routing; and support telemetry instrumentation, migration from legacy platforms, and tool consolidation. The role also supports automation and deployment on Kubernetes/Red Hat OpenShift and Linux platforms, application of security and compliance practices, and preparation of documentation, runbooks, and training to transfer operational ownership to staff.

Requirements

At least 7 years of job-related work experience beyond degree requirements, including at least 3 years of hands-on Grafana stack experience in production.
Bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent knowledge gained through a combination of education and experience.
Hands-on experience implementing and administering Grafana, Loki, Tempo, and Prometheus or Mimir at enterprise scale.
Strong experience with PromQL, LogQL, and Grafana alerting.
Experience with OpenTelemetry instrumentation and collectors.
Experience with Kubernetes and Red Hat OpenShift, including deploying observability components via Helm or Operators.
Scripting and automation skills, such as Bash or Python, and experience with infrastructure-as-code tools such as Ansible or Terraform.
Experience with CI/CD and Git-based workflows.
Working knowledge of at least one commercial APM or monitoring platform, such as Dynatrace or Splunk, and experience conducting tool rationalization or migration.
Linux administration skills; RHEL is preferred.
Understanding of networking, storage, and security concepts as they apply to monitoring and telemetry pipelines.
Strong analytical and problem-solving skills.
Strong written and verbal communication skills, including the ability to document clearly and present recommendations to technical and management audiences.

Nice To Haves

Experience integrating with SSO or identity providers such as Okta, OIDC, or SAML.

Responsibilities

Assess monitoring and observability tools for functional overlap, coverage gaps, and consolidation opportunities, and document findings and recommendations.
Assist with Grafana stack design and implementation for metrics, logs, and traces, including architecture, sizing, high availability, and retention strategy.
Integrate Grafana with enterprise tooling and data sources such as Dynatrace, Splunk, and xMatters, as well as identity and SSO providers.
Build and standardize dashboards, alert rules, SLIs/SLOs, and on-call notification routing with application and infrastructure teams.
Support application and infrastructure instrumentation using OpenTelemetry, exporters, and agents; help define telemetry standards and onboarding patterns.
Support migration of dashboards, alerts, and monitoring use cases from legacy tools to Grafana and assist with decommissioning redundant tools.
Automate deployment, configuration, and maintenance using infrastructure-as-code and CI/CD tools and Git-based pipelines.
Assist with deploying and operating observability components on Kubernetes, Red Hat OpenShift, and Linux (RHEL) platforms.
Help apply security and compliance practices, including RBAC, secrets management, data retention, and auditability.
Contribute to runbooks, architecture documentation, and training materials, and assist with knowledge transfer for operational ownership.