About The Position

The Production Engineer, HPC Reliability & Automation supports a growing multi-cloud AI infrastructure. The role requires strong High-Performance Computing (HPC) and Site Reliability Engineering (SRE) experience, with a focus on troubleshooting operational problems across compute, accelerators, workload scheduling, storage, and networking. The engineer turns investigation findings into proactive detection, diagnosis, and safe automated remediation, including agent-enabled workflows. Production HPC experience is essential; prior experience building or orchestrating AI agents is welcome but not required. The role is open to candidates in the United States who live within the Pacific Time Zone and is 100% remote. The expected compensation range is $100,000 to $200,000, with final compensation depending on factors including location, skills, and relevant experience. The position is eligible for Wipro's standard benefits, including medical and dental benefit options, disability insurance, paid time off (including sick leave), and other paid and unpaid leave options.

Requirements

  • Production experience with HPC, GPU/accelerator clusters, or large-scale distributed computing in a reliability-focused engineering role.
  • Strong Linux and networking skills, including troubleshooting processes, containers, storage I/O, DNS, connectivity, and authentication.
  • Multi-cloud observability experience using Prometheus, Grafana, OpenTelemetry, centralized logging, or similar tools.
  • Strong Python or Go automation experience.
  • Demonstrated ownership of complex production investigations through root cause and permanent resolution.
  • Site Reliability Engineering (SRE) experience.
  • More than 10 years of experience.

Nice To Haves

  • Slurm, Kubernetes, or similar HPC scheduling or cluster orchestration experience.
  • Experience supporting AI training or accelerator-intensive workloads, including GPU/TPU health, distributed-job failures, interconnect issues, data-loading bottlenecks, or checkpointing.
  • Experience with AWS, GCP, CoreWeave, or OCI and cloud-native observability.
  • HPC storage or networking experience with NFS/POSIX, Lustre, object storage, RDMA/InfiniBand, or RoCE.
  • Infrastructure automation experience with Terraform, Helm, or cluster operators.
  • Experience building or orchestrating AI agents for infrastructure operations.

Responsibilities

  • Understand and support multi-cloud HPC architecture across clusters, schedulers, accelerators, storage, networking, and authentication.
  • Proactively identify reliability and performance issues by correlating logs, metrics, and events across cloud environments.
  • Troubleshoot issues across Linux, containers, schedulers, distributed workloads, storage, networking, and accelerators to identify root cause.
  • Turn investigations into repeatable automation and agent-enabled workflows for detection, diagnosis, and safe remediation.
  • Strengthen observability and monitoring.
  • Partner with infrastructure, research, security, and cloud-provider teams on long-term fixes.

Benefits

  • Medical benefits options
  • Dental benefits options
  • Disability insurance
  • Paid time off, inclusive of sick leave
  • Other paid and unpaid leave options
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service