About The Position

You will be in charge of open-sourcing state-of-the-art models, whilst maintaining and improving Mistral's publicly available libraries. Your work is critical in helping turn research breakthroughs into tangible solutions and improve Mistral's open-source ecosystem.

Requirements

  • Master's degree in Computer Science, Machine Learning, Data Science, or a related field
  • Experience contributing to popular open-source libraries such as PyTorch, Tensorflow, JAX, vLLM, Transformers, Llama.cpp, ...
  • Passion for contributing to the open-source software ecosystem
  • Expert programming skills in Python, PyTorch, MLOps
  • Adaptable, proactive, and autonomous
  • Attention to detail and a drive to go the last mile to build almost perfect tools
  • Deep understanding of machine learning approaches, especially LLMs and algorithms
  • Low-ego, collaborative and have a real team player mindset

Nice To Haves

  • Experience with training and fine-tuning large language models (e.g., distillation, supervised fine-tuning, policy optimization)
  • Experience working with Slurm
  • Worked with research teams before
  • Experience as a core-maintainer of a popular ML open-source library

Responsibilities

  • Releasing our models to open-source platforms and libraries, e.g., vLLM, GitHub, Hugging Face
  • Maintaining Mistral's open-source libraries (mistral-common, mistral-finetune, mistral-inference)
  • Create and maintain tooling and services: both internal facing (internal research) and external facing (open-source libraries)
  • Implement and optimize open-source and internal libraries for performance and accuracy, ensuring production readiness and employing cutting-edge technology and innovative approaches
  • Collaborate with the open-source community (PyTorch, vLLM, Hugging Face)

Benefits

  • Competitive salary and equity
  • Health insurance
  • Transportation allowance
  • Sport allowance
  • Meal vouchers
  • Private pension plan
  • Generous parental leave policy
  • Visa sponsorship
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service