AI Quality & Safety Engineer
About The Position
Lotus AI is a primary care app that combines your medical records, AI, and real doctors to deliver free, personalized care (including prescriptions and referrals). We’re backed by Kleiner Perkins + CRV, and we’re a small team that ships fast. You will ensure Lotus feels safe, reliable, and works day-to-day for patients. This role sits close to product and engineering and blends quality, debugging, and building lightweight systems that catch issues before users do. This is not traditional QA or customer support. It’s a hands-on, product-adjacent role focused on turning real user issues into fixes, better evaluations, and tighter systems.
Requirements
- You like debugging and figuring out what’s actually happening.
- You can write code (usually Python) and you’re comfortable with logs and messy data.
- You care about doing things carefully
- You enjoy being the glue between product, engineering, and users.
Nice To Haves
- Python and SQL.
- Comfort reading logs/traces, reproducing issues, and writing crisp bug reports.
- Familiarity with LLM evals, RAG, and prompting (or willingness to learn quickly).
- Strong judgment with sensitive data and HIPAA-aware habits.
Responsibilities
- Run evaluations and regression checks on real workflows before/after model or data changes.
- Track common failure modes and convert them into repeatable tests.
- Triage patient issues and product bugs, and help drive fast resolution.
- Partner with clinicians and engineers on safety/quality escalations.
- Build lightweight tooling and dashboards to surface what’s breaking.
Benefits
- The work directly impacts real people. If you want to ship quickly and care about quality, this role is a strong mix.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
