Job Title: MT/QE Evaluations Project Manager
Location:Cupertino CA 95014/Austin TX 78727 (Hybrid-3days Onsite)
Duration: 5+ Months

Description:

The MT/QE Evaluations Project Manager will support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) models. This role focuses on ensuring statistically sound evaluations, high-quality datasets, and the generation of actionable insights. Responsibilities include running evaluations that assess MT and QE performance and risk, and connecting linguistic quality frameworks with data analysis.

This role requires strong data science, analytical, organizational, and communication skills.

Qualification:

• Demonstrable experience in NLP/ML evaluations or localization analytics.
• Knowledge of evaluation design and statistical analysis, including determining statistically significant sample sizes.
• Experience with benchmarking against human judgments and applying MT and QE evaluation metrics.
• Skilled in analyzing evaluation results and ensuring findings are reliable and actionable.
• Proficiency with data analysis and visualization tools (e.g., Python, Tableau).
• Highly organized, analytical, detail-oriented, and methodical.
• Strong communication skills — able to communicate effectively with both technical and business audiences.
• Ability to explain technical results in a clear and understandable manner.
• Strong eye for patterns, anomalies, and trends across large datasets.

 
 
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 66.08/hr.