Sr. Lead - AI Engineer

Klaviyo • Boston, MA

8d • Onsite

About The Position

Klaviyo is hiring a Sr. Lead Software Engineer for its Core Orchestration platform in the Boston hub. The role is based in the hub-first work model, with regular in-office collaboration expected.

The Orchestrate pillar provides high-throughput capabilities customers use to manage and execute complex marketing workflows. The team is building a flexible orchestration platform for massive scale, while advancing reliability and performance to serve a global customer base. The role will help shape Klaviyo’s investments in Marketing AI and Service AI, including agentic capabilities that can run, optimize, and adapt based on real-time outcome and reward signals.

The engineer will architect and scale reliable, low-latency services; lead integration of AI-driven agentic workflows into customer interactions; and advance AI-native development practices. The role also involves creating foundational frameworks used across engineering, mentoring and guiding technical standards, and partnering with product, data science, design, and executive leaders on strategic roadmaps and platform architecture.

Requirements

• At least 8 years of professional software engineering experience focused on distributed systems, microservices architecture, and ownership of high-availability backend platforms.
• Hands-on experience shipping production LLM workflows, retrieval-augmented generation (RAG) pipelines, or agentic frameworks.
• Understanding of AI evaluations, prompt architecture, and fine-tuning.
• Experience architecting event-driven systems, asynchronous processing pipelines, and message queues for high-throughput workloads.
• Deep proficiency in Python and modern frameworks such as FastAPI or Django.
• Experience with data processing platforms and object-relational mapping tools.
• Strong expertise with AWS, Kubernetes, CI/CD automation, and modern observability suites.
• Experience establishing automated AI model evaluation frameworks and balancing latency, accuracy, cost, and safety in production.
• Technical leadership skills, including architectural direction, collaborative problem-solving, and clear communication across engineering and business domains.
• Ability to collaborate directly with product managers, ML engineers, and customers, translating customer needs, product goals, and technical constraints.
• Active use of AI coding tools and modern agentic development workflows in daily work.
• Customer-focused approach and ability to translate complex customer needs into resilient software architecture.

Nice To Haves

• Experience designing or integrating shared AI/ML platforms used by multiple internal engineering teams.
• Domain expertise in MarTech, e-commerce platforms, personalization engines, or real-time event streaming.

Responsibilities

• Architect and scale Klaviyo’s Core Orchestration platform, supporting high-traffic, low-latency services with extreme reliability.
• Drive the technical vision for integrating AI-driven agentic workflows and automated decision-making into core customer interactions.
• Lead adoption of AI-native software development practices to improve engineering productivity and delivery speed.
• Design foundational frameworks and services adopted across engineering teams.
• Champion high technical standards through design reviews and mentorship.
• Partner with product management, data science, design, and executive leaders to shape strategic roadmaps and long-term platform architecture.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed