Senior MLOps Engineer

Salvo Software

About The Position

Salvo Software is seeking a Senior MLOps Engineer to build and own the infrastructure and workflows that bring machine learning and LLM-powered systems reliably into production. The role focuses on creating a dependable path from experimentation to production, including training and fine-tuning pipelines, model registries, automated deployment, scalable inference, and monitoring across cloud, on-premises, and air-gapped environments. This is a hands-on senior position responsible for defining MLOps standards and platform architecture, making decisions about reliability, scalability, and cost, and providing technical guidance to AI Developers and RAG Engineers. The engineer will collaborate with engineering, product, and client stakeholders to ensure AI features are reproducible, observable, secure, and ready to scale.

Requirements

  • At least 5 years of senior-level experience in DevOps, SRE, or platform engineering.
  • At least 1 year deploying ML models and LLM inference engines such as Ollama or vLLM in production.
  • Proficiency with Linux, Docker, Kubernetes, virtualization such as Proxmox or VMware, GPU infrastructure such as CUDA/NVIDIA, and major cloud platforms such as AWS, Azure, or GCP.
  • Hands-on expertise with Infrastructure as Code tools such as Terraform and Ansible; CI/CD platforms such as GitHub Actions and Azure DevOps; and Bash and Python scripting.
  • Solid background in networking, including DNS, TLS, firewalls, and VPNs; monitoring and logging; and security and authentication, including OAuth2/OIDC, API gateways, and Zero Trust/SOC 2.

Nice To Haves

  • Familiarity with ML tooling such as MLflow and Kubeflow.
  • Familiarity with vector databases and RAG or agent frameworks such as MCP.
  • Familiarity with workflow orchestration such as Airflow or Kafka.
  • Familiarity with model optimization and quantization.

Responsibilities

  • Design, deploy, and operate MLOps platform infrastructure, cloud services, and LLM inference pipelines.
  • Build automated CI/CD pipelines, infrastructure as code, and monitoring and alerting systems for RAG applications, AI agents, and production deployments.
  • Manage Linux servers, networking, and security endpoints, and troubleshoot production issues with AI engineering teams.
  • Establish department-wide MLOps and DevOps standards, best practices, and reusable infrastructure templates.
  • Guide AI Developers and RAG Engineers on architecture, deployment strategies, tool selection, and production readiness.
  • Translate feature requirements into reliable, secure, and cost-effective infrastructure and maintain comprehensive system documentation.
  • Provision containerized workloads, Linux servers, and infrastructure using IaC across cloud and on-premises environments.
  • Manage CI/CD, observability tools, secure networking, and GPU-enabled hardware.
  • Troubleshoot platform incidents, perform root cause analysis, and maintain operational resilience.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service