Runway is seeking an ML infrastructure engineer to own model evaluation end to end and build a unified evaluation platform. The role will develop systems to generate model samples at scale, score them using automated metrics and human annotations, track results across checkpoints and releases, and deliver results to researchers quickly. The engineer will define operational standards for measuring model quality, assessing confidence, and determining when results support shipping decisions. Embedded within research teams as part of ML Platform, this role will set technical direction for evaluations across the company. It will work with researchers across video, image, audio, agents, and robotics, translating their measurement needs into reusable platform capabilities. The platform will support research and integrate with training, production model serving, and other company efforts. Runway’s inference and training code uses Python and PyTorch in a cloud-native environment, with multiple clouds and Kubernetes-native and custom job orchestration tooling. The role has access to models, agents, GPUs, storage, and cloud services for building the evaluation pipeline.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed