About The Position

As part of the work on machine-generated dialog we are developing novel measurements of its quality. These include cutting-edge llm-judges for aspects like groundedness (lack of hallucinations), Siri Tone and Style (a suite of Design requirements), Safety, and others.To measure our progress on this front, we need to track the state of our dataset composition, accuracy of llm-judges, human expert review results in a central and visual representation. A DRI for Metrics and Reporting will:

Requirements

  • Experience with writing and architecting production level code
  • Deep understanding of Machine Learning concepts
  • Experience in Model training and/or evaluation
  • Good engineering practices to create sustainable and easy to use metric reporting pipelines
  • Attunement to computational linguistics, language quality is a plus

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Industry

Computer and Electronic Product Manufacturing

Education Level

No Education Listed

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service