Academic Subject Matter Experts - Francophone studies

DataForce by TransPerfect • Montreal, QC

5d • Remote

About The Position

We are seeking highly qualified Academic Subject Matter Experts (SMEs) to support the development and evaluation of next-generation Artificial Intelligence (AI) systems. Academic Subject Matter Experts will use their academic expertise to create challenging, academically rigorous question-and-answer (Q&A) pairs designed to evaluate advanced AI reasoning capabilities. Questions should require advanced subject-matter reasoning and be supported by authoritative academic and/or primary sources. Depending on project requirements, contributors may also be asked to review and refine AI-generated responses. The work demands deep subject-matter knowledge, rigorous analytical thinking, and the ability to interpret and work confidently with complex academic materials, often in their original language(s). We are recruiting experts holding a Master's degree or PhD in Francophone Studies.

Requirements

• Master's degree or PhD in the relevant academic discipline (Francophone studies).
• Familiarity with generative AI technologies and AI evaluation methodologies.
• Demonstrated expertise through academic study, research, teaching, or publication.
• Excellent analytical, critical-thinking, and research skills.
• Ability to communicate and justify complex academic judgments clearly and precisely in writing.
• Strong attention to detail and an uncompromising commitment to accuracy.
• Idiomatic fluency in French with the confidence to work directly with original-language academic materials.
• Professional-level written English, if required for project deliverables (with primary sources cited in their original language).

Nice To Haves

• Previous work in AI data creation, annotation, evaluation, or Large Language Model (LLM) projects strongly preferred.
• University teaching or research experience.
• Experience creating educational, assessment, or knowledge-based content.

Responsibilities

• Create original, academically rigorous Q&A pairs in your area of expertise, that require advanced reasoning, are supported by authoritative academic sources, and are designed to challenge current AI models.
• Design questions that demand advanced reasoning, synthesis, and specialized domain knowledge rather than easily retrievable facts.
• Evaluate and critique AI-generated responses against defined criteria, and revise or rewrite them to a higher standard where required.
• Reference primary and secondary academic sources (literature, historical texts, films, manuscripts, scholarly publications, and other discipline-specific material) to ground and verify your work.
• Ensure factual accuracy, internal consistency, source traceability, and adherence to project guidelines.
• Refine content in response to quality-assurance feedback.
• Participate in qualification and calibration exercises prior to project assignment.

What This Job Offers

• Job Type: Part-time
• Career Level: Mid Level