Staff Backend AI Platform Engineer

Freshworks•San Mateo, CA
•$225,000 - $278,000•Hybrid

About The Position

Freshworks is seeking a Backend AI Platform Engineer to lead the development of core backend services for its Agentic AI Platform. The role is the primary technical driver for building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. Working with the Principal AI Architect, the engineer will translate high-level designs into scalable implementations and own high-performance APIs and orchestration runtimes, integrating frameworks such as LangChain, LangGraph, and LangSmith. This is a hands-on technical leadership role in a fast-paced environment, with an emphasis on strong engineering standards. The position includes leading agent runtime orchestration, designing APIs and SDKs, managing state and memory for context-aware agents, and implementing multi-agent communication. It also involves developing cloud-native, event-driven backend services; managing scheduled and long-running workflows; optimizing LLM orchestration; maintaining RAG pipelines and vector database integrations; and ensuring observability, security, tenant isolation, testing, and reliability. The engineer will mentor junior backend engineers and provide technical guidance and code reviews. This is a hybrid role based at Freshworks' San Mateo, California headquarters, with onsite expectations three days per week, Tuesday through Thursday. The annual base salary range is $225,000–$278,000, and the role is eligible for a target bonus.

Requirements

  • At least 6 years of backend engineering experience.
  • At least 1–2 years of hands-on experience in AI/ML platform development.
  • Strong programming skills in Java and Python.
  • Hands-on experience with LangChain, LangGraph, or LangSmith.
  • Deep understanding of event-driven architectures, microservices, and Kubernetes.
  • Solid experience with AWS and Terraform.
  • Experience with relational databases such as PostgreSQL and vector databases.
  • Practical experience with workflow engines such as Temporal or Airflow and messaging systems such as Kafka.

Nice To Haves

  • Experience with AI-driven planning systems or dialog state tracking.
  • Background in enterprise security, including RBAC, SSO, or OAuth2.
  • Experience working in a high-growth SaaS or startup environment.
  • Active contributions to open-source backend or AI frameworks.

Responsibilities

  • Lead implementation of agent runtime orchestration services, including reasoning, planning, and tool invocation.
  • Own development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows.
  • Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents.
  • Implement multi-agent communication protocols and shared context systems.
  • Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures.
  • Build and manage task scheduling and long-running operations using workflow tools such as Temporal or Airflow.
  • Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.
  • Implement and maintain RAG pipelines and integrations with vector databases such as Pinecone, Weaviate, and FAISS.
  • Ensure backend services support LangSmith-based evaluation and comprehensive observability.
  • Implement RBAC, API authentication, and multi-tenant isolation logic.
  • Set standards for automated unit, integration, and load testing, and implement OpenTelemetry for system visibility.
  • Provide technical guidance and code reviews for junior backend engineers.

Benefits

  • Target bonus eligibility
  • Dental, medical, vision, disability, and life insurance options
  • Equity and employee stock purchase plan (ESPP)
  • Flexible PTO
  • Flexible spending benefits
  • Commuter benefits
  • Wellness benefits
  • Adoption and parental leave benefits
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service