Lead Cloud Software Engineer - 11629

Coupa Software•Foster City, CA

1d•Hybrid

About The Position

AI is reshaping how the world builds, learns, and connects. At our company, we believe the next generation of enterprise software will be powered by AI-driven platforms that are secure, scalable, and built for constant innovation. As our Lead of AI LLM Platform DevOps team, you will build solutions that enable this vision. From CI/CD pipelines, ML Ops, GenAI, Agentic AI platforms to AI governance and observability, you will define how our engineers build, test and ship the technologies that power global enterprises. This is your chance to lead & shape the evolution of Coupa’s AI platform. You will lead system design, code development, deployment, automation for our LLM/GenAI/Agentic AI platforms ensuring reliability, scalability of infrastructure.

Requirements

10+ years of hands-on platform engineering experience with 3+ years in technical leadership roles, including experience managing complex cloud infrastructure at enterprise scale
Deep expertise in cloud-native architectures, multi-cloud strategies, and advanced services across AWS or GCP, with proven experience designing systems that handle millions of transactions
Proven track record designing and implementing large-scale platform solutions, including microservices architectures, container orchestration, and distributed systems patterns
Expert-level programming skills in multiple languages (Python, Go, Java, etc.) with extensive experience building sophisticated automation frameworks and platform tools
Deep expertise in enterprise CI/CD design, MLOps pipelines , and DevOps transformation initiatives, with experience implementing these practices across large engineering organizations
Proven ability to make complex technical trade-offs, evaluate emerging technologies, and drive architectural decisions that balance current needs with long-term scalability
Enterprise AI platform infrastructure development experience
Experience building enterprise grade, scalable, cost-efficient, secure AI/ML platforms with a focus on resiliency, automation, observability.
Deployment and Life cycle Management of LLM & Embedding Models (OpenAI, AWS Bedrock, Amazon SageMaker) and Vector Databases like LanceDB
Exposure to evaluation of new products and technologies like RAG, MCP servers, AI Agents, Agentic Workflows, LangChain etc.
Manage AWS core & AI /GenAI services (S3, IAM, EKS, Bedrock, etc), Expert in IaC (Terraform).
Deep knowledge of Docker and Kubernetes (especially GKE or EKS) for scaling inference services, Build, deploy workloads.
A leader who thrives in fast-moving environments, motivates teams, and embraces innovation.
Strong communication skills across geographies.
BS/MS in Computer Science or equivalent experience.

Responsibilities

Define and drive the long-term technical vision for Agentic AI platform and LLM infrastructure, making strategic decisions on technology choices, architectural patterns and platform evolution.
Architect complex, multi-tenant platform systems that support high availability, scalability, and security requirements across global multi-cloud environments
Lead and mentor a team of platform devops engineers, providing technical guidance, code reviews, and career development while fostering a culture of engineering excellence
Define and implement best practices, coding standards and architectural principles that ensure consistency, reliability, and maintainability across all platform components
Involve in evaluation of new products and technologies like RAG, MCP servers. AI Agents, Agentic Workflows, etc.
Deployment and Life cycle Management of LLM & Embedding Models.
Build and manage MLOps pipeline.
Infrastructure As Code (IaC e.g Terraform) with Multi Cloud Deployments.
Ensure technical quality through code reviews, architecture discussions, and engineering standards.
Collaborate with the Principal Architect and AI/ML Engineering Lead on technical direction.
Collaborate with platform, Dev & QE teams to plan & deploy the releases.
Participate in design reviews, code reviews, troubleshooting incidents & write, and review Incident RCAs