AI Applied Scientist - PhD Intern, Evaluation Systems and Metrics

Zillow

103d • $104,000 - $166,000

About The Position

The Zillow AI Applied Science team develops next-generation evaluation methodologies for generative AI, computer vision, and agentic systems. We work at the intersection of research and production, designing evaluation frameworks that assess current AI capabilities and adapt as technology advances. We are seeking remote PhD interns for Summer 2026! As an intern, you will help develop cutting-edge evaluation methodologies for AI systems. Your research will focus on creating robust, scalable metrics and frameworks to assess the quality, consistency, and performance of generative models across multiple modalities.

Requirements

• Currently enrolled as a PhD student in computer science, machine learning, computer vision, or a related field, with strong publication record.
• Background in evaluation methodologies for AI/ML systems.
• Experience with computer vision metrics and 3D consistency assessment.
• Knowledge of generative model evaluation (text, image, video, 3D).
• Experience with multi-modal assessment and automated feedback systems.
• Knowledge of data privacy methods (e.g., differential privacy, federated learning, secure ML) and their application.
• Familiarity with single agent or multi-agent system evaluations.
• Familiarity with modern deep learning frameworks (e.g., PyTorch, Hugging Face Transformers).
• Strong research mindset, with motivation to publish.
• Interest in applying AI to complex, multi-stakeholder domains.

Nice To Haves

• A record of publication in conferences, workshops, or journals.

Responsibilities

• Develop innovative assessment methodologies for emerging AI capabilities, focusing on consistency and quality across complex multi-modal outputs.
• Design evaluation systems that learn and adapt from feedback, automatically discovering new evaluation criteria and improving assessment quality over time.
• Design frameworks that incorporate domain-specific implementations of differential privacy to protect sensitive user information while maintaining utility for model training and assessment.

Benefits

• Comprehensive medical, dental, vision, life, and disability coverages.
• Parental leave and family benefits.
• Retirement contributions.
• Paid time off.

What This Job Offers

• Career Level: Intern
• Education Level: Ph.D. or professional degree
• Number of Employees: 251-500 employees