Machine Translation Quality Engineering Evaluations Project Manager

TEKsystems•Cupertino, CA

4d•Hybrid

About The Position

The MT/QE Evaluations Project Manager will support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) Models. This role focuses on ensuring statistically sound evaluations, high-quality datasets, and the generation of actionable insights. Running evaluations that assess MT and QE performance and risk, connecting linguistic quality frameworks with data analysis. This role requires strong data science, analytical, organizational, and communication skills.

Requirements

Demonstrable experience in NLP/ML Evaluations, or Localization Analytics.
Knowledge of evaluation design & statistical analysis, including determining statistically significant sample sizes.
Experience with benchmarking against human judgments, and applying MT & QE evaluation metrics.
Skilled in analyzing evaluation results, ensuring findings are reliable and actionable.
Proficiency with data analysis and visualization tools (e.g. Python, Tableau).
Highly organized, analytical, detail-oriented, and methodical.
Strong communication skills — able to communicate effectively with both technical and business audiences.
Ability to explain technical results in a clear and understandable manner.
Strong eye for patterns, anomalies, and trends across large datasets.

Nice To Haves

project management
python
machine translation

Responsibilities

Support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) Models.
Ensure statistically sound evaluations, high-quality datasets, and the generation of actionable insights.
Run evaluations that assess MT and QE performance and risk.
Connect linguistic quality frameworks with data analysis.