Bask Health is seeking a Senior Machine Learning Engineer, Evaluation & Reliability to design, build, and maintain systems that measure and improve the quality of its AI-powered applications. As AI capabilities expand across patient experiences, merchant tools, clinical workflows, and internal operations, this role will establish the infrastructure, evaluation methods, and monitoring practices needed to deploy AI features reliably. The role combines machine learning engineering, software infrastructure, automated testing, and production reliability. The engineer will build evaluation pipelines, benchmark datasets, regression tests, monitoring systems, and tools that help teams identify failures before they affect users. Evaluation will address accuracy, relevance, grounding, consistency, application requirements, and safety—not simply whether a model responds. The engineer will investigate production issues and collaborate with applied AI engineers to improve prompts, retrieval systems, model configurations, and application behavior. In healthcare-related workflows, the role will help establish safeguards, support human review where appropriate, and ensure AI systems meet defined quality expectations before deployment. This is a hands-on senior engineering position with ownership of evaluation infrastructure and reliability practices. The engineer will contribute production code, design scalable testing systems, establish reusable standards, mentor other engineers, and own improvements from technical design through deployment and ongoing maintenance.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed