AI Orchestration Engineer

Sage Care • Palo Alto, CA

3d • Hybrid

About The Position

An AI Orchestration Engineer focuses on designing, implementing, and maintaining the “glue” that coordinates multiple AI models, agents, and workflows into a cohesive system. Rather than just building models, this role ensures they interact effectively, scale properly, and integrate seamlessly into real-world applications.

Requirements

• Programming: Proficiency in Python, TypeScript, or Go (depending on orchestration stack)
• Frameworks: Experience with LangGraph, LangChain, or Ray
• Infrastructure: Strong knowledge of Docker, Kubernetes, CI/CD pipelines, and observability tools (Prometheus, Grafana)
• AI/ML Understanding: Familiarity with LLMs, RAG systems, embeddings, and multi-agent patterns
• Data Systems: Experience with vector databases (FAISS, Pinecone, Weaviate) and caching systems (Redis, Memcache)

Nice To Haves

• Hands-on experience with healthcare workflows or regulated environments
• Exposure to human-in-the-loop AI systems
• Background in reliability engineering or distributed systems

Responsibilities

• Workflow & Pipeline Orchestration Build and manage directed workflows (DAGs, state machines, LangGraph flows)
• Define how data and context move between AI models, APIs, and humans in the loop
• Multi-Agent Collaboration Design coordination strategies for multiple AI agents with specialized roles
• Implement arbitration logic to merge outputs, resolve conflicts, and dynamically route tasks
• Integration & Infrastructure Connect AI systems with vector databases, APIs, cloud platforms, and external data sources
• Handle orchestration across distributed environments (Kubernetes, serverless)
• Reliability & Error Handling Implement retries, fallbacks, and guardrails to keep workflows stable
• Ensure systems degrade gracefully when AI outputs are uncertain or incorrect
• Optimization & Evaluation Tune orchestration for cost, latency, and accuracy
• Build observability dashboards, logging, and metrics to measure workflow success

Benefits

• Mission-driven work at the intersection of AI and healthcare
• Collaborative team that values curiosity, creativity, and ownership
• Flexibility to experiment with the newest orchestration frameworks and AI infrastructure

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 1-10 employees