AI Platform Engineer II

Klaviyo • Boston, MA

6h • Hybrid

About The Position

At Klaviyo, we believe the future of software lies not in productivity tools for human users but in software that can run and optimize itself based on outcome or reward metrics. We’ve built the infrastructure and application that serve as the interface between businesses and consumers. We now have over 167,000 customers, billions of consumer profiles, and hundreds of billions of customer messages and follow-on conversion data. We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our products and develop AI agents that can automatically create and execute marketing or customer experiences, strategies, and campaigns for any business. As a AI Platform Engineer, you’ll play a key role in designing and scaling the backend systems that power our AI products and agent solutions. This backend-heavy role gives you opportunities to influence architecture, async processing, and distributed systems. You’ll collaborate closely with product managers, ML engineers, and data scientists to deliver real-world impact at scale. This role is hybrid and based in Boston.

Requirements

• 3+ years of experience as a backend software engineer, building scalable, distributed systems.
• Experience working in production environments.
• Hands-on experience with generative AI and agentic AI applications in production.
• Proficient in Python (or similar).
• Comfortable collaborating with cross-functional technical partners.
• Curious, proactive, and eager to learn.

Nice To Haves

• Experience with big data tools (e.g., Apache Spark, Ray).
• Familiarity with cloud infrastructure (AWS, Terraform, Kubernetes).
• Knowledge of ML frameworks (Huggingface, PyTorch, TensorFlow, Keras).

Responsibilities

• Design and build backend systems to scale AI solutions for 167K+ customers.
• Contribute to our agentic architecture to support performant AI agents.
• Build tools to tune LLM-based features, deploy agents, MCP and RAG in production, and evaluate performance using tools like Arize, OpenAI, Bedrock, LangChain, vLLM and Ray.
• Develop reliable, scalable data pipelines and APIs for AI systems.
• Foster a culture of ownership, experimentation, and customer-first thinking.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 501-1,000 employees