Senior Software Engineer - AI Platform Engineering

Mayo Clinic • Rochester, MN

1d • Hybrid

About The Position

This hybrid Senior Software Engineer position must be located within 100 miles of a Mayo Clinic campus for occasional on-site work based on business needs. The engineer will help architect and build model and agent runtimes: specialized engines that govern how models and autonomous agents execute across Mayo Clinic’s hybrid-cloud footprint. The role focuses on creating a platform that makes AI capabilities scalable, secure, and governed through AgentOps, LLMOps, and MLOps practices.

The position involves designing high-performance hosting environments for models and agents, building multi-tenant capabilities for execution across cloud and on-premises environments, and implementing production monitoring, distributed tracing, and automated evaluation. The engineer also participates in a rotational platform operations team to support the reliability and uptime of critical AI services and partners with cross-functional AI teams to improve workflows and accelerate delivery of AI-driven value.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field and 5 years of experience; or an associate degree in Computer Science, Engineering, or a related field and 7 years of experience.
• In-depth software engineering knowledge and experience coding applications or services in a high-level programming language, preferably Python.
• Basic knowledge of related fields.
• Demonstrated problem-solving and time-management skills.
• Strong technical aptitude for designing and implementing software solutions.
• Experience with modern application development frameworks.
• Knowledge of professional software engineering practices across the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Deep hands-on technical expertise.
• Excellent verbal and written communication skills.
• Experience with Agile software development techniques.

Nice To Haves

• Master’s degree in Computer Science, Engineering, or a related field.
• Ability to use a wide variety of open-source technologies and cloud-based services.
• Experience writing cloud software for GCP, AWS, or Azure.
• Experience with databases, analytics, big data systems, or business intelligence products.
• Experience building high-performance, highly available, and scalable distributed systems.
• Experience developing software for healthcare-related industries.
• Authorization to work and remain in the United States without Mayo Clinic sponsorship now or in the future.

Responsibilities

• Design and implement high-performance hosting environments for specialized models and autonomous agents.
• Build multi-tenant platform capabilities for model and agent execution across cloud and on-premises environments.
• Implement real-time monitoring, distributed tracing, and automated evaluation of agents and models in production.
• Participate in a rotational platform operations team to ensure the reliability and uptime of critical AI services.
• Partner with cross-functional AI teams to identify system friction, streamline workflows, and accelerate delivery of AI-driven value.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior