Model Behavior Architect

Mistral AI

138d

About The Position

As a Model Behavior Architect, you’re at the forefront of shaping LLM system behaviour to align to Mistral’s values. We’re looking for people who have experience with Literature and Translation, who are experts in model evaluation, prompt engineering, and policy writing. Your role would include helping our Science team create AI systems that respond with good generations across diverse scenarios. Join us if you are passionate about tackling cutting-edge, open-ended research challenges and transforming your findings into best-in-class model responses.

Requirements

• Deep understanding of the humanities; whether it’s literature, language, anthropology, philosophy, political science, film, etc.
• Prior knowledge in training and optimising model behaviour and building evaluations
• Keen to dive into prompt generations and unit tests
• Thrives in dynamic and technically complex environments
• Track record of delivering innovative, out-of-the-box solutions to address real-world constraints

Responsibilities

• Interact with models to identify where model behavior can be improved
• Gather internal and external feedback on model behavior to scope areas for improvement
• Design and implement subtle prompting strategies, data generation, and evaluation pipelines that steer better model responses
• Identify and fix edge case behaviors through rigorous testing of your data generation pipelines
• Develop evaluations of language model behaviors
• Work collaboratively with AI Scientists on related teams like Alignment, RAG, Multimodal, Audio, and Code Generation

What This Job Offers

• Number of Employees: 251-500 employees