Humanities Evaluation Specialist | Remote , Contract

Xperteez Technology•,

6d•Remote

About The Position

We are engaging Humanities Evaluation Specialists to contribute to a customer's innovative AI project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Requirements

Research & source triangulation
Attention to detail
Written precision
Self-direction & reliability
Analytical thinking
Humanities studies & experience

Nice To Haves

Advanced academic background or professional experience in a humanities discipline such as history, literature, philosophy, linguistics, classics, art history, or journalism.
Exceptional analytical writing, close-reading, and question formulation skills.
Demonstrated meticulousness and ability to document reasoning and sources clearly.
Experience producing challenging, nuanced questions that probe for understanding beyond surface-level facts.
Self-directed and highly reliable in delivering project tasks independently within a remote context.
Familiarity with AI model evaluation or training is a plus, though not required.

Responsibilities

Develop original, high-difficulty question-and-answer pairs that challenge advanced AI models on interpretation, argument, context, and analytical reasoning within the humanities.
Research, verify, and provide authoritative citations to support accurate answers and reasoning, referencing primary texts and reputable sources.
Design prompts that demand deep analytical or interpretive insight rather than surface-level recall.
Test questions against AI models, iterating to increase difficulty and sharpen clarity while ensuring correctness.
Write with precision and attention to detail, crafting unambiguous questions and well-supported answers.
Apply feedback from reviewers to refine submissions and maintain alignment with project guidelines and quality standards.