Job Title: Annotation Project Specialist
Duration: 12 Months
Location: Burlingame, CA or Redmond, WA
 
Key Responsibilities

• Vendor Management & Delivery
• Oversee annotation vendor performance, ensuring timely and high-quality data deliveries.
• Track and report on vendor success metrics.
• Coordinate onboarding & certification of new raters.
• Guideline Implementation & Development
• Ensure correct implementation of annotation guidelines.
• Partner with researchers to develop, refine, and update annotation guidelines.
• Quality Assurance & Data Quality
• Uphold the researcher quality bar and high data quality standards.
• Oversee DQA (Double Quality Assurance) processes and success.
• Develop, review, and improve quality assurance processes.
• Manage DQA resources and reporting.
• Training & Coordination
• Organize and deliver annotator training sessions.
• Coordinate with annotation vendors for ongoing training and calibration.
• Reporting & Communication
• Report on annotation metrics and quality trends.
• Provide monthly written updates.
• Communicate expectations, progress, and changes with research and vendor stakeholders.

Skills:
Must Haves:
3+ years’ experience in annotation project management roles in all 3 skill sets:

• Training annotators on guidelines
• Using annotation tooling
• Quality Assurance of annotations

Nice to Have Skills:

• Background or familiarity with software engineering concepts and troubleshooting. Technical aptitude in a software technical engineering language 

Education:

• Bachelor’s degree or higher

 About the Team

• At Reality Labs Research, our goal is to explore, innovate, and design novel interfaces and hardware for virtual, augmented, and mixed reality experiences. We are driving research towards a vision of an always-on augmented reality device that can enable high-quality contextually relevant interactions across a range of complex, dynamic, real-world tasks in natural environments; to achieve this goal, our team draws on methods and knowledge from artificial intelligence, machine learning, computer vision, and human–computer interaction. More broadly, the chosen candidate will work with a diverse and highly interdisciplinary team of researchers and engineers and will have access to cutting edge technology, resources, and testing facilities. 

How is success defined?             
1. Perform day-to-day responsibilities.
2. Work autonomously, navigate ambiguity, and collaborate cross-functionally.
 
What makes this role interesting?
Unique opportunity to work at the forefront of innovation, tackling complex challenges with cutting-edge technology and data.
 
Value Added/Experience Gained: You will collaborate with world-class experts in a dynamic environment that fosters creativity, impact, and continuous learning, driving breakthroughs that shape the future of Meta's products and services.
 
Interview Process

• Round 1 w/ CWAM, 45 Mins
• Round 2 w/ TBD, 45 Mins

 
 
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 45.00/hr.