Staff AI Engineer
About The Position
At Rula, we're building AI with purpose. Our work sits at the intersection of cutting-edge technology and human empathy, focused on one goal: creating a future where high-qualty mental healthcare is the standard for all. To bring this to life, we're bringing AI-assisted therapy that supports, not replaces, providers, helps patients get the right care faster, and raises the standard for what compassionate digital care can be. As a Staff AI Engineer - AI Foundation, you'll define the core technical systems that make this possible. You'll architect and scale production-grade Generative AI powering patient conversations, provider decision support, and clinical operations. From RAG pipelines and multi-agent orchestration to LLM integrations, vector search, and evaluation frameworks, you'll build the infrastructure that turns experimentation into reliable, real-world impact in healthcare. This role is both deeply hands-on and highly influential. You'll work across AI research, platform engineering, product, and clinical teams to design systems that are safe, observable, and built for scale in a regulated environment. You'll set technical direction, mentor other engineers, and help shape Rula's AI roadmap, leading at the frontier of AI and healthcare, where your work directly contributes to better outcomes and meaningful change in people's lives.
Requirements
- 8+ years of software engineering, including 7+ years of experience with public cloud (AWS, GCP, etc.), 5+ years designing and scaling distributed systems.
- 5+ years of deep experience in Python and at least one backend language (preferably JavaScript, TypeScript, Java, or Go)
- 1+ years of proven track record building production-grade AI systems, such as training, inference, evaluation, and safeguards that power AI product features at scale
- Strong expertise in LLM integration patterns (RAG, function calling, agents, memory routing, etc.), AI orchestration frameworks (eg. LangChain, LlamaIndex, DSPy, Haystack), and vector databases (eg. Pinecone, Weaviate, FAISS, Milvus).
- Deep understanding of AIOps, data pipelines, evaluation, and observability systems for continuous model improvement.
- Strong and effective communication skills.
- Bachelor's degree or above in Computer Science, Machine Learning, or related field.
Nice To Haves
- Experience delivering secure and compliant AI solutions in regulated environments (HIPAA, GDPR, etc.)
- Hands-on experience with foundation models (OpenAI, Anthropic, Bedrock, Gemini, etc.)
- Familiarity with human-in-the-loop systems and clinical decision support frameworks.
- Experience designing evaluation pipelines for human alignment, factual accuracy, or model interpretability.
- Contributions to open-source AI frameworks or applied research in NLP, healthcare AI, or GenAI safety.
- Experience working in a highly regulated industry such as finance or healthcare
- Experience contributing to early-stage team growth (0 → 1)
Benefits
- 100% remote work environment
- Attractive pay and benefits
- Comprehensive health benefits : Medical, dental, vision, life, disability, and FSA/HSA
- 401(k) plan access
- Generous time-off policies : Including 2 company-wide shutdown weeks each year for self-care (for most employees)
- Paid parental leave : Available for all parents, including birthing, non-birthing, adopting, and fostering
- Employee Assistance Program (EAP) : Support for your mental and physical health
- New hire home office stipend : Set up your workspace for success
- Quarterly department stipend : Fund team-building activities or in-person gatherings
- Wellness events and lunch & learns : Explore a variety of engaging topics
- Community and employee resource groups : Participate in groups that celebrate employee identity and lived experiences, fostering a sense of community and belonging for all
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
