Senior Software Engineer, Research

Hippocratic AI • Menlo Park, CA

5d • Onsite

About The Position

Hippocratic AI's AI agents are already working inside real hospitals and health systems — this role owns the backend infrastructure that keeps them fast, reliable, and ready to scale as that footprint grows. You'll architect systems built for tomorrow's volume, not just today's, working closely with data scientists, ML engineers, and product managers to turn healthcare requirements into production-grade infrastructure.

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, or a related field (Master's preferred)
• 4+ years of backend development experience using Python, Golang, or similar languages
• Experience building and maintaining multi-modal (speech, vision, text) data pipelines using Ray, Apache Airflow, or similar for distributed processing and model experimentation, including distributed computing frameworks like Spark or Hadoop
• Familiarity with relational database systems and RESTful APIs
• Basic understanding of cloud infrastructure (AWS, GCP, or similar)

Nice To Haves

• Exposure to AI/ML concepts or experience working with LLMs
• Experience working in teams that handle sensitive or regulated data
• Familiarity with gRPC, GraphQL, or similar
• Experience with real-time audio
• Exposure to DevOps concepts — CI/CD, deployment, Terraform, build systems
• Experience with data science

Responsibilities

• Architect backend systems that sustain 99.9%+ uptime for high-volume healthcare data and LLM processing as usage grows exponentially
• Implement monitoring that surfaces issues before they reach production AI agents
• Own performance and reliability improvements across backend systems in collaboration with data scientists and ML engineers
• Design data pipelines that ingest, process, and prepare large-scale, multi-modal (speech, vision, text) healthcare datasets for training and inference with minimal latency
• Build tag management and metadata systems that make large datasets organized and retrievable
• Develop and optimize infrastructure supporting data ingestion, feature extraction, and tagging workflows
• Develop APIs and microservices that reduce processing time and improve responsiveness for AI model interaction and data retrieval
• Build infrastructure that makes ML workflows reproducible end-to-end, from data preparation through model deployment
• Accelerate time-to-production for new AI capabilities

Benefits

• We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior