Engineering Manager, AI Quality
About The Position
At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come. This is a rare chance to help build a generational company at a true inflection point. With 700+ customers in 58+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched. Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us. At Harvey, the future of professional services is being written today — and we’re just getting started. Role Overview The quality of Harvey’s AI & Search systems is of critical importance. Our customers expect us to produce accurate, specific, verifiable and personalized results across all of our product surfaces. They also expect the quality of our answers to continuously get benchmarked and improved. In this role, you will drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products). This includes establishing the right evaluation processes and tools, creating and evangelizing reusable AI building blocks, and working closely with all product teams to continuously improve the quality of Harvey’s AI outputs. You will be responsible for building out tools and processes and for establishing a strong culture of scientific experimentation, rigorous evaluation, and iterative improvements.
Requirements
- Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies.
- Excellent software engineering skills; experience working in teams that built and operated production systems
- Excellent communication skills, both written and verbal.
- Ability to roll up your sleeves and build team, processes, and technology from the ground up.
- A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields.
Responsibilities
- Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation.
- Build out core AI quality building blocks that can be reused across different teams and surface areas.
- Own search & retrieval quality, both for AI applications as well as other use cases.
- Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products.
- Work closely with platform engineering to scale our capabilities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Manager
Education Level
No Education Listed
Number of Employees
251-500 employees
