Role: Project Manager
Location: Austin, TX / Cupertino, CA / San Diego, CA (Hybrid , 3 days a week)
Duration: 11 + Months
 
The MT/QE Evaluations Project Manager will support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) Models. This role focuses on ensuring statistically sound evaluations, high-quality datasets, and the generation of actionable insights. Running evaluations that assess MT and QE performance and risk, connecting linguistic quality frameworks with data analysis.
 
This role requires strong data science, analytical, organizational, and communication skills.
 
Qualifications:

• Demonstrable experience in NLP/ML Evaluations, or Localization Analytics.
• Knowledge of evaluation design & statistical analysis, including determining statistically significant sample sizes.
• Experience with benchmarking against human judgments, and applying MT & QE evaluation metrics.
• Skilled in analyzing evaluation results, ensuring findings are reliable and actionable.
• Proficiency with data analysis and visualization tools (e.g. Python, Tableau).
• Highly organized, analytical, detail-oriented, and methodical.
• Strong communication skills — able to communicate effectively with both technical and business audiences.
• Ability to explain technical results in a clear and understandable manner.
• Strong eye for patterns, anomalies, and trends across large datasets.

 
 
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 65.00/hr.