Forward Deployed Engineer

Hippocratic AI

1d

About The Position

The Forward Deployed Engineer is the technical owner for AI deployments. You will be a core contributor to our agentic AI platform. This is a high-ownership role where you work closely with Deployment Strategists and customers, building real production systems that directly impact healthcare operations. You need to be a strong software engineer who enjoys working in customer environments and taking ownership of end-to-end system reliability.
You have expertise in software development in python, experience with frameworks such as langchain and langsmith, deep understanding of LLM techniques such as RAG, LLM as a judge, and MCP/tool calling.

Requirements

• 3-5 years of software engineering experience with strong Python fundamentals and production software development experience
• Hands-on experience with LLM frameworks (LangChain, LangSmith) and understanding of modern LLM development patterns
• Deep understanding of LLM techniques: RAG, prompt engineering, tool calling, LLM-as-judge, and related patterns
• Experience building integrations with APIs, databases, or enterprise systems; comfort with async patterns and error handling
• Bachelor's degree in Computer Science (or related field) from a top ranked university.

Nice To Haves

• Experience with Model Context Protocol (MCP) or similar approaches for tool integration
• Healthcare IT experience (EHR integrations, FHIR, HL7, healthcare data standards)
• Production DevOps or infrastructure experience; ability to set up monitoring and incident response
• Experience deploying AI systems or working with LLMs in production environments

Responsibilities

• AI Innovation & Problem-Solving – Identify customer challenges and design AI solutions using advanced LLM techniques (RAG, tool calling, LLM-as-judge); implement novel approaches to healthcare AI problems
• RAG Pipeline Implementation – Design and implement retrieval-augmented generation pipelines that ground LLM responses in customer data, ensuring accuracy and clinical relevance
• Tool & MCP Architecture – Implement tool-calling architectures and Model Context Protocol (MCP) connections that enable agents to interact with customer systems safely
• Python AI Development – Build production Python code using LangChain, LangSmith, and modern AI frameworks to create reliable AI systems
• Infrastructure & Deployment – Set up secure, monitored production environments; manage deployment and go-live activities
• Production Monitoring & Support – Monitor deployed systems, respond to incidents, troubleshoot problems with customers, implement fixes

Benefits

• Backed by $404M from top-tier AI and healthcare investors—CapitalG, a16z, General Catalyst, Kleiner Perkins, plus strategic health system investors. This validates the category and gives you the resources to focus on innovation without runway concerns.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior