Latch builds scientific benchmarks for AI agents across biology and is developing RadiologyBench to evaluate how well AI agents handle real medical-imaging workflows. The role is for professionals who read or acquire medical images and who can judge image quality and clinical findings with expert care. You will determine the correct answer for each case and build studies that assess agents, from whether a scan was acquired properly to what it shows. You will review agent performance, including missed findings and reported findings that are not present. The resulting evaluations help research labs understand where their models fall short of expert performance. Work spans MRI, CT, ultrasound, and radiography across organ systems. You will design interpretation tasks by writing questions commonly asked by radiologists, choosing suitable answer formats, defining pass criteria, reviewing agents’ approaches, and identifying what agents need to accomplish the objective. The role requires professional experience with medical images, strong expertise in at least one modality and working familiarity with others, and the ability to use Python to interpret results and run scripts. No specific ML engineering experience is required. Latch describes its culture as transparent, collaborative, and respectful. The company uses AI constantly and values original expert judgment rather than AI output presented as one’s own. Employees start on a bench aligned with their expertise and may move across teams as they build a track record. The position offers output-based individual-contributor and management growth paths. It may be fully remote, though onsite work is preferred at the company’s Mission Bay waterfront office in San Francisco. In the US, the role is full-time W-2, with a guaranteed state-set base salary and OTE-based pay. The first four weeks are paid at full OTE during ramp-up, and full OTE is paid when quota cannot fairly apply. Outside the US, the role is contractor-based and paid on performance, with a monthly advance of 60% of OTE that is never clawed back; US benefits do not apply. The interview process includes an application, take-home project, technical interview, culture interview, offer, and background check after acceptance.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Entry Level
Education Level
No Education Listed