AI Validation & Automation Engineer

Kyndryl•Dallas, TX
•$143,640 - $327,600

About The Position

The AI Validation & Automation Engineer is accountable for providing objective evidence that infrastructure is ready for production. The role owns validation, performance baselines, defect closure, and acceptance evidence supporting customer sign-off and go/no-go decisions. It creates requirements-to-test traceability and staged readiness gates; develops version-controlled automation; validates GPU and accelerator systems, fabrics, storage, Kubernetes, and telemetry; and executes failure and recovery tests. The role establishes workload-relevant baselines, coordinates defect resolution and retesting, produces formal acceptance packages, and uses deployment findings and production incidents to improve automated coverage and prevent recurrence. The position requires nationwide travel to customer data centers as needed, with the percentage to be confirmed. The U.S. compensation range is $143,640 to $273,000 for a full-time schedule, with different ranges for certain locations. The position is eligible for a discretionary annual bonus and a comprehensive benefits package. Applications are accepted on a rolling basis.

Requirements

  • At least 5 years in infrastructure validation, automation, performance engineering, commissioning, or quality engineering.
  • Strong Linux scripting and automation skills with Python, Ansible, APIs, Git, and CI/CD.
  • Experience defining acceptance criteria, analyzing diagnostics, and managing defects to closure.

Nice To Haves

  • NVIDIA DCGM diagnostics and telemetry, CVT, MLXlink, fabric validation, GPU burn-in, or NCCL tests.
  • Validation experience with DGX/HGX, InfiniBand, Spectrum-X, BlueField, Kubernetes operators, NVAIE, or Run:ai.
  • Experience producing customer acceptance packages for NVIDIA DGX/HGX or NVIDIA-Certified AI infrastructure.
  • NVIDIA or HPC benchmarking credentials and test-engineering credentials such as ISTQB or equivalent.

Responsibilities

  • Create a requirements-to-test traceability matrix and staged entry/exit gates covering site readiness, physical installation, power-on, fabric, storage, platform, burn-in, performance, resiliency, and handover.
  • Develop version-controlled provisioning, health-check, diagnostic, stress, regression, and evidence-collection automation.
  • Validate GPU or accelerator health, PCIe, GPU interconnects such as NVLink/NVSwitch, NIC/HCA/DPU, InfiniBand or Ethernet/RoCE fabrics, storage throughput, Kubernetes, operators, scheduling, and telemetry.
  • Execute failure and recovery tests, including node loss, link degradation, service restart, workload rescheduling, rebuild, replacement, and return to service.
  • Establish workload-relevant baselines for collective communications, network, storage, inference, training, and platform operations without assuming ownership of every customer model benchmark.
  • Triage failures, isolate defects, coordinate corrective actions, retest, and maintain auditable defect and acceptance records.
  • Produce formal acceptance packages containing configuration baselines, test results, exceptions, waivers, evidence, sign-offs, and residual risks.
  • Use deployment findings and production incidents to extend automated coverage and prevent recurrence.

Benefits

  • Medical coverage
  • Dental coverage
  • Disability benefits
  • Retirement benefits
  • Paid leave
  • Paid time off
  • Eligibility for Kyndryl's discretionary annual bonus program, subject to plan terms
  • Employee learning programs and access to industry certifications
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service