AI Operations Engineer

Brigham Young University•Provo, UT
•$104,500 - $135,500

About The Position

The AI Operations Engineer operates and improves BYU’s hybrid enterprise AI environment, including locally hosted AI services and approved vendor platforms. The role administers model-serving and agent platforms, maintains service reliability and security, and coordinates with infrastructure, security, data governance, privacy, procurement, and application teams. The position also directs the day-to-day work of student employees who support monitoring, service requests, testing, documentation, and platform operations.

Requirements

  • A firm commitment to the mission of BYU.
  • Bachelor’s degree in information technology, computer science, systems engineering, or a related field; or equivalent education and experience.
  • Professional experience administering production Linux, networking, storage, automation, container, or distributed application environments.
  • Experience operating GPU, high-performance computing, model-serving, machine-learning, or similarly resource-intensive production services.
  • Experience administering enterprise software or API services, including identity integration and role-based access.
  • Working knowledge of inference endpoints, model versions, embeddings, model routing, and related technologies.
  • Knowledge of monitoring, capacity planning, incident response, change management, configuration management, backup, and recovery.
  • Knowledge of security and data-governance practices, such as least privilege, secrets management, audit logging, and data classification.
  • Experience directing, mentoring, or coordinating technical staff, student employees, or project teams.
  • Strong troubleshooting, documentation, coordination, and communication skills.

Nice To Haves

  • Experience with NVIDIA GPU platforms, CUDA, NCCL, tensor parallelism, or distributed inference.
  • Experience with Kubernetes or OpenShift, infrastructure as code, configuration management, or CI/CD.
  • Experience with enterprise AI services such as ChatGPT Enterprise/Edu, Codex, or comparable platforms.
  • Experience with agent frameworks, tool integrations, sandboxes, or evaluation workflows.
  • Experience with vector databases, embeddings, semantic search, data pipelines, or enterprise connectors.
  • Familiarity with the NIST AI Risk Management Framework or related guidance.
  • Experience managing vendor support, licensing, usage limits, and cloud or hybrid-service costs.

Responsibilities

  • Operate and maintain local GPU systems, approved AI models, inference services, and their supporting configurations.
  • Administer enterprise AI platforms, including user access, roles, licenses, service accounts, connectors, and usage controls.
  • Configure model routing and service settings to meet workload needs and follow approved data boundaries.
  • Maintain AI agent platforms and workflows, including tools, permissions, sandboxes, and approval steps.
  • Monitor service health, performance, capacity, and cost; maintain alerts, runbooks, backup procedures, and recovery plans.
  • Respond to service incidents, coordinate vendor support, and use approved fallback procedures when services are disrupted.
  • Work with security, privacy, legal, records, accessibility, and data-governance partners on platform and use-case reviews.
  • Direct, train, and provide feedback to student employees; assign work and review its quality.

Benefits

  • Competitive pay structure.
  • 401k. BYU automatically contributes 8% at no cost to you. Additionally, if you contribute 5%, BYU adds an additional 4% (Rehires may qualify for different retirement plans).
  • Excellent work-life balance: 13 paid holidays + 22 days paid vacation + 12 sick days, accrued annually.
  • Employee assistance program, available to the employee and all members of their household.
  • Tuition benefits for employees and eligible family members.
  • Access to athletic facilities.
  • Excellent medical/dental benefits.
  • Short/long-term disability benefits.
  • Paid parental and maternity leave.
  • Wellness Program.
  • Free on-campus parking.
  • Free UTA passes for employees, spouses, and qualified dependents.
  • Discounts at the BYU Store and for many events at BYU.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service