About The Position

The Enterprise Observability Engineering team is a high-impact, high-autonomy group focused on building intelligent, scalable, and resilient observability solutions. We foster a culture of innovation, agility, and ownership—empowering engineers to solve complex problems, drive strategic initiatives, and shape the future of how we monitor and operate distributed systems. If you're passionate about building tools engineers love, solving unscoped challenges, and leading with technical excellence—this is the team for you. We’re looking for a Lead Software Engineer with deep expertise in logging and observability engineering. You should be fluent in the principles of open telemetry, log ingestion, and event correlation across distributed systems. While familiarity with platforms like Splunk or Dynatrace is a plus, we value platform-agnostic thinking and the ability to design resilient, scalable logging solutions using the best-fit tools for the environment. As a Lead Software Engineer, you will drive the design, implementation, and evolution of our observability and logging platforms. You’ll lead enterprise-scale initiatives, mentor engineers, and collaborate across disciplines to ensure our systems are reliable, scalable, and performant. Applying deep technical expertise to solve real-world challenges. You’ll work closely with SRE, Security, Networking, Platform Engineering, and Data Science teams to evolve our observability strategy using AI/ML and cloud-native technologies.

Requirements

  • Associate degree in Computer Science, Engineering, or related field.
  • 7+ years in software/infrastructure engineering with observability/logging focus.
  • Strong foundation in operating systems, networking, algorithms, and distributed systems.
  • Expertise in: Programming (eg. Python, .Net, Java, Go, Node.js)
  • Expertise in: System architecture and AI Ops
  • Expertise in: CI/CD (eg. GitHub Actions, Azure DevOps)
  • Expertise in: Infrastructure as Code (eg. Terraform, Ansible)
  • Expertise in: Cloud-native development (eg. Azure, AWS, GCP)
  • Expertise in: API design (eg. REST, gRPC)
  • Proven leadership and mentoring experience.
  • Agile delivery experience and strategic thinking around observability maturity.

Nice To Haves

  • 5+ years with a technical bachelor’s degree
  • Open telemetry
  • Experience with Splunk Enterprise & ES (SPL, dashboards, correlation searches, data models)
  • Scaled and complex Data onboarding (HEC, UF, TA development)
  • Integration with SNOW, SOAR, ITSM/SecOps tools
  • Experience with Dynatrace, Cribl, Grafana
  • Monitoring and alerting strategy design
  • Budget management and cost optimization
  • Automation and continuous delivery practices
  • Leading cross-functional programs across technologies
  • Certified Splunk Admin and Advanced Power User

Responsibilities

  • Architect and optimize observability environments through software engineering best practices.
  • Build automation scripts and tools to streamline observability instrumentation and deployment.
  • Integrate observability into CI/CD pipelines using infrastructure-as-code (IaC) and configuration management tools.
  • Conduct observability code reviews and implement automated validation checks.
  • Build AI-native tools for autonomous issue detection and resolution.
  • Lead the design of distributed systems focused on reliability, scalability, and performance.
  • Manage data routing, transformation, and endpoint monitoring integrations.
  • Mentor junior engineers and foster a culture of continuous improvement.
  • Collaborate across teams to align observability strategies with business goals.
  • Communicate technical insights and recommendations to leadership.

Benefits

  • medical
  • dental
  • vision benefits
  • 401(k) retirement savings plan
  • time off (including paid time off, company and personal holidays, volunteer time off, paid parental and caregiver leave)
  • short-term and long-term disability
  • life insurance

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Senior

Education Level

Associate degree

Number of Employees

5,001-10,000 employees

© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service