Senior Software Engineer - AI Platform Engineering

Mayo Clinic • Rochester, MN

4d

About The Position

The Role As a Senior Software Engineer for AI Platform Engineering, you will bridge the gap between high-scale systems architecture and frontier AI. You will be one of architects and builders of our Model & Agent Runtimes —the specialized engines that govern how models and autonomous agents execute across our hybrid-cloud footprint. This isn't just about deployment; it’s about a platform-first mindset. You will ensure that AI capabilities are scalable, secure, and governed through world-class AgentOps, LLMOps, and MLOps practices.

Requirements

• Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate’s degree in Computer/Science/Engineering or related field with 7 years of experience.
• Have in-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fields.
• Demonstrated problem solving and time management skills.
• Possesses strong technical aptitude for designing and implementing software solutions.
• Experience with modern application development frameworks
• Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Deep hands-on technical expertise, excellent verbal and written communication skills.
• Experience with Agile software development techniques.

Nice To Haves

• Master's degree in Computer Science/Engineering or related field.
• Ability to use a wide variety of open-source technologies and cloud-based services.
• Experience writing software for the cloud (GCP, AWS, Azure).
• Experience in databases, analytics, big data systems or business intelligence products.
• Experience building high-performance, highly available and scalable distributed systems.
• Experience developing software for healthcare related industries.

Responsibilities

• Architect the Future of Runtimes: Design and implement high-performance hosting environments for both specialized models and autonomous agents.
• Scale Hybrid-Cloud Infrastructure: Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments.
• Drive Operational Excellence: Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production.
• Operational Stewardship: Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services.
• Collaborate & Advocate: Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior