Senior Software Engineer - AI Platform Engineering

Mayo Clinic•Rochester, MN

1d•$141,024 - $204,526

About The Position

As a Senior Software Engineer for AI Platform Engineering, you will bridge the gap between high-scale systems architecture and frontier AI. You will be one of the architects and builders of our Model & Agent Runtimes—the specialized engines that govern how models and autonomous agents execute across our hybrid-cloud footprint. This isn't just about deployment; it’s about a platform-first mindset. You will ensure that AI capabilities are scalable, secure, and governed through world-class AgentOps, LLMOps, and MLOps practices.

Requirements

Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (Kubernetes).
Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures.
A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments.
The ability to turn abstract AI research into production-grade, hardened platform features.

Responsibilities

Design and implement high-performance hosting environments for both specialized models and autonomous agents.
Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments.
Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production.
Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services.
Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value.