Senior Software Engineer - AI Platform Engineering
About The Position
The Senior Software Engineer for AI Platform Engineering designs and builds Model & Agent Runtimes that govern how models and autonomous agents execute across Mayo Clinic’s hybrid-cloud footprint. The role focuses on creating scalable, secure, and governed AI capabilities through AgentOps, LLMOps, and MLOps practices. This is a hybrid position. The employee must be located within 100 miles of a Mayo Clinic campus to meet occasional on-site expectations based on business needs. The role participates in a rotational platform operations team responsible for reliability and uptime of critical AI services and collaborates with cross-functional AI teams to streamline workflows and accelerate delivery of AI-driven value.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field and 5 years of experience, or an associate’s degree in Computer Science, Engineering, or a related field and 7 years of experience.
- In-depth software engineering knowledge and experience coding applications or services in a high-level programming language, preferably Python.
- Basic knowledge of related fields.
- Demonstrated problem-solving and time-management skills.
- Strong technical aptitude for designing and implementing software solutions.
- Experience with modern application development frameworks.
- Knowledge of professional software engineering practices and best practices across the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Deep hands-on technical expertise.
- Excellent verbal and written communication skills.
- Experience with Agile software development techniques.
- Authorization to work and remain in the United States without Mayo Clinic sponsorship now or in the future.
Nice To Haves
- Master’s degree in Computer Science, Engineering, or a related field.
- Ability to use a wide variety of open-source technologies and cloud-based services.
- Experience writing software for the cloud, including GCP, AWS, or Azure.
- Experience with databases, analytics, big data systems, or business intelligence products.
- Experience building high-performance, highly available, and scalable distributed systems.
- Experience developing software for healthcare-related industries.
- Experience building scalable back-end systems, ideally with containerization and orchestration such as Kubernetes.
- Strong understanding of LLM and autonomous-agent lifecycles, including inference optimization and RAG architectures.
- Track record of implementing observability, including logging, metrics, and tracing, in complex distributed environments.
- Ability to turn abstract AI research into production-grade, hardened platform features.
Responsibilities
- Design and implement high-performance hosting environments for specialized models and autonomous agents.
- Build multi-tenant platform capabilities for model and agent execution across cloud and on-premises environments.
- Implement real-time monitoring, distributed tracing, and automated evaluation of agents and models in production.
- Participate in a rotational platform operations team to ensure reliability and uptime of critical AI services.
- Partner with cross-functional AI teams to identify system friction, streamline workflows, and accelerate delivery of AI-driven value.
Benefits
- Medical plan options.
- Dental coverage through Delta Dental or a reimbursement account for flexible coverage.
- Vision plan with a national network.
- HSA and FSAs for eligible expenses.
- Competitive retirement package.
- Continuing education and advancement opportunities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
