Senior Software Engineer - AI Platform Engineering
About The Position
The Senior Software Engineer for AI Platform Engineering designs and builds Model and Agent Runtimes: specialized engines that govern model and autonomous-agent execution across Mayo Clinic’s hybrid-cloud footprint. The role focuses on developing scalable, secure, and governed AI capabilities through AgentOps, LLMOps, and MLOps practices. The engineer creates high-performance hosting environments for models and agents, builds multi-tenant platform capabilities across cloud and on-premises environments, and implements monitoring, distributed tracing, and automated production evaluation. The position also participates in a rotational platform operations team responsible for the reliability and uptime of critical AI services and partners with cross-functional AI teams to streamline workflows and accelerate delivery of AI-driven value. This is a hybrid position. The employee must be located within 100 miles of a Mayo Clinic campus for occasional on-site expectations based on business needs.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field and 5 years of experience, or an associate degree in Computer Science, Engineering, or a related field and 7 years of experience.
- In-depth knowledge of software engineering and experience coding applications or services in a high-level programming language, preferably Python.
- Basic knowledge of related fields.
- Demonstrated problem-solving and time-management skills.
- Strong technical aptitude for designing and implementing software solutions.
- Experience with modern application development frameworks.
- Knowledge of professional software engineering practices and the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Deep hands-on technical expertise.
- Excellent verbal and written communication skills.
- Experience with Agile software development techniques.
- Authorization to work and remain in the United States without Mayo Clinic sponsorship now or in the future.
Nice To Haves
- Master’s degree in Computer Science, Engineering, or a related field.
- Ability to use a wide variety of open-source technologies and cloud-based services.
- Experience writing software for cloud platforms such as GCP, AWS, or Azure.
- Experience in databases, analytics, big data systems, or business intelligence products.
- Experience building high-performance, highly available, and scalable distributed systems.
- Experience developing software for healthcare-related industries.
- Experience building scalable back-end systems, especially with containerization and orchestration such as Kubernetes.
- Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures.
- Track record implementing observability, including logging, metrics, and tracing, in complex distributed environments.
- Ability to turn abstract AI research into production-grade, hardened platform features.
Responsibilities
- Design and implement high-performance hosting environments for specialized models and autonomous agents.
- Build multi-tenant platform capabilities supporting agent and model execution across cloud and on-premises environments.
- Implement real-time monitoring, distributed tracing, and automated evaluation of agents and models in production.
- Participate in a rotational platform operations team to ensure the reliability and uptime of critical AI services.
- Partner with cross-functional AI teams to identify system friction, streamline workflows, and accelerate delivery of AI-driven value.
Benefits
- Competitive compensation and comprehensive benefit plans.
- Medical plan options.
- Dental coverage through Delta Dental or a reimbursement account for flexible coverage.
- Vision plan with a national network.
- HSA and FSA options for eligible expenses.
- Competitive retirement package.
- Continuing education and advancement opportunities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
