AI Orchestration Engineer

Sage Care Inc • Palo Alto, CA

111d

About The Position

Sage Care is a fast-growing, early-stage healthcare startup founded by exceptional leaders from Apple, Uber, Carbon Health and backed by top-tier venture capital (General Catalyst, Chelsea Clinton). With a strong customer pipeline, Sage Care is transforming healthcare by simplifying care navigation. Our platform makes it easier for patients to find the right doctor, helps providers focus on those who need them most, and ensures faster access to care—delivering better care and stronger economic outcomes at scale through harnessing the latest AI innovations. An AI Orchestration Engineer focuses on designing, implementing, and maintaining the 'glue' that coordinates multiple AI models, agents, and workflows into a cohesive system. Rather than just building models, this role ensures they interact effectively, scale properly, and integrate seamlessly into real-world applications.

Requirements

• Proficiency in Python, TypeScript, or Go (depending on orchestration stack)
• Experience with LangGraph, LangChain, or Ray
• Strong knowledge of Docker, Kubernetes, CI/CD pipelines, and observability tools (Prometheus, Grafana)
• Familiarity with LLMs, RAG systems, embeddings, and multi-agent patterns
• Experience with vector databases (FAISS, Pinecone, Weaviate) and caching systems (Redis, Memcache)

Nice To Haves

• Hands-on experience with healthcare workflows or regulated environments
• Exposure to human-in-the-loop AI systems
• Background in reliability engineering or distributed systems

Responsibilities

• Build and manage directed workflows (DAGs, state machines, LangGraph flows)
• Define how data and context move between AI models, APIs, and humans in the loop
• Design coordination strategies for multiple AI agents with specialized roles
• Implement arbitration logic to merge outputs, resolve conflicts, and dynamically route tasks
• Connect AI systems with vector databases, APIs, cloud platforms, and external data sources
• Handle orchestration across distributed environments (Kubernetes, serverless)
• Implement retries, fallbacks, and guardrails to keep workflows stable
• Ensure systems degrade gracefully when AI outputs are uncertain or incorrect
• Tune orchestration for cost, latency, and accuracy
• Build observability dashboards, logging, and metrics to measure workflow success

Benefits

• Mission-driven work at the intersection of AI and healthcare
• Collaborative team that values curiosity, creativity, and ownership
• Flexibility to experiment with the newest orchestration frameworks and AI infrastructure

What This Job Offers

• Number of Employees: 251-500 employees