Software Engineer III (AI/ML)

Guidewire Software • San Mateo, CA

2d • $114,000 - $202,000 • Hybrid

About The Position

Are you passionate about building large-scale, next-generation Generative AI (GenAI) capabilities? Do you thrive in cross-functional teams tackling mission-critical business challenges? Are you experienced in designing agentic workflows and integrating state-of-the-art LLM, ML, and MCP (Model Context Protocol) technologies? Join our highly collaborative Solution Engineering and Operations team to design and deliver intelligent, next-generation services and solutions powered by cutting-edge AI innovation.

Requirements

• 5+ years of software engineering experience, with exposure to AI/ML and backend platform development.
• Proficiency in Python, TypeScript, or JavaScript, with strong coding and debugging skills.
• Hands-on experience with cloud and container technologies such as AWS, Docker, and Kubernetes.
• Familiarity with AI orchestration frameworks (LangChain, LangGraph, CrewAI) and GenAI design patterns such as RAG, ReAct, and agent-based reasoning.
• Experience building or integrating MCP servers to manage tools, context, and state across LLMs and external systems.
• Expertise with LLM APIs (OpenAI, Claude, Gemini, etc.) and multi-model orchestration.
• Strong foundation in API design, microservice architecture, and event-driven systems.
• Knowledge of authentication and security standards, including OAuth2, JWT, and secure coding practices.
• Experience with databases such as PostgreSQL or DynamoDB.
• Passion for building intelligent platforms that leverage AI to improve efficiency, reliability, and automation.
• BS/MS in Computer Science or a related field, or equivalent professional experience.

Nice To Haves

• Experience with additional AI/ML frameworks or cloud platforms.
• Exposure to insurance technology or enterprise SaaS environments.
• Contributions to open-source AI/ML projects.
• Experience with ethical AI and governance best practices.

Responsibilities

• Design, build, and maintain scalable microservices and APIs that power AI capabilities across core solutions and offerings.
• Develop Generative AI pipelines using frameworks such as LangChain, LlamaIndex, and MCP-based integrations to enable context-aware reasoning and action orchestration.
• Collaborate with ML engineers and data scientists to integrate and operationalize models from providers like OpenAI and Anthropic.
• Design and deploy ML models that drive predictive insights, anomaly detection, and automated decision-making.
• Design and extend MCP servers to define, expose, and manage tools accessible to LLMs.
• Implement continuous evaluation and retraining workflows to ensure models remain accurate and relevant as business data evolves.
• Work closely with platform teams to align ML and GenAI components with enterprise standards for security, reliability, and performance.
• Ensure scalability, performance, and security of AI workloads in multi-tenant cloud environments (AWS, Kubernetes).
• Participate in architecture reviews and define MCP-compliant interfaces for consistent, safe model–tool interactions.

Benefits

• Flexible work environment, including hybrid options.
• Comprehensive health and wellness benefits.
• Paid time off programs, including volunteer time off.
• Market-competitive pay and incentive programs.
• Continual development and internal career growth opportunities.
• In-person orientation process for all new hires, fostering connection and collaboration from day one.
• health, dental, and vision insurance
• paid time off
• company sponsored retirement plan

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level