Senior Software Engineer, Research

Hippocratic AI•Menlo Park, CA

1d•Onsite

About The Position

Hippocratic AI is building the first safe, healthcare-focused LLM designed to transform patient outcomes at scale. Our AI agents are already working with real hospitals and health systems. We need a Senior Research Engineer who can architect systems that don't just work at today's scale, but anticipate tomorrow's growth. You'll own the infrastructure that powers our AI agents, ensuring they're fast, reliable, and ready for the demands of production healthcare.

Requirements

Bachelor’s degree in Computer Science, Computer Engineering, or a related field. (Master's is preferred)
4+ years of experience in backend development using programming languages like Python, Golang, or similar.
Experience building and maintaining multi-modal data pipelines (speech, vision, and text) using Ray or Apache Airflow for distributed processing and model experimentation.
Distributed computing with Spark, Hadoop, or similar.
Familiarity with relational database systems and RESTful APIs.
Basic understanding of cloud infrastructure (e.g. AWS, GCP).

Nice To Haves

Exposure to AI/ML concepts or experience working with LLMs.
Experience working in teams that handle sensitive or regulated data.
Familiarity with gRPC, graphQL or similar .
Experience with real-time audio.
Exposure to DevOps concepts - CI/CD, deployment, terraform, build systems.
Experience with data science.

Responsibilities

Develop and maintain scalable backend systems to support high-performance AI applications in healthcare.
Collaborate with cross-functional teams, including data scientists and ML engineers, to design and build efficient data pipelines for large-scale healthcare datasets.
Build and manage APIs and microservices that enable smooth data retrieval, processing, and interaction with AI models.
Monitor and improve backend systems to optimize performance, reliability, and uptime.
Work closely with product managers to understand healthcare requirements and help transform them into technical solutions.
Develop and optimize backend infrastructure supporting data ingestion, feature extraction, and tagging workflows.
Implement tag management and metadata systems to streamline dataset organization and retrieval.
In-person collaboration: 5 days weekly in Menlo Park—working alongside physicians, ML engineers, and product teams to move healthcare AI forward