Job Description:
Job Title: Generative AI Data Quality Scientist
Location: Bellevue, WA Or Boston, MA
Duration: 9 Months

As a Data Quality Scientist in domain STEM, you will play a crucial role in evaluation and enhancement of our AI models' STEM reasoning, ensuring precision and reliability in AI-generated STEM content.
This role requires a unique blend of technical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world applications. Your work will directly influence the development of next-generation AI STEM assistants.

Key Responsibilities:
• Evaluate and analyze quality of STEM content across various sub-domains (mathematics, biology, physics, chemistry, etc.)
• Benchmark model performance based on human ground truth
• Partner with AI researchers to identify optimization opportunities and enhance model accuracy
• Conduct in-depth analysis of human audit data to identify patterns and areas for improvement

Required Qualifications:
• Bachelor's or Master's degree in Data Science, Computer Science, STEM, Mathematics, or related field
• 2+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) experience
• 2+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience
• Strong programming skills in Python, with experience in data analysis libraries (NumPy, Pandas, SciPy)
• Proven experience in statistical analysis
• Strong analytical and problem-solving skills

Preferred Qualifications:
• Experience with AI/ML systems evaluation, particularly in STEM applications
• 2+ years of data scientist experience
• 2+ years of experience in machine learning model development and implementation
• Understanding of machine learning concepts, particularly as they apply to natural language processing and image processing
• Deep understanding one of STEM domains and has background in STEM domain
• Experience with deep learning framework (PyTorch)
• Experience with version control systems (e.g., Git) and data visualization tools 

About Us: SPECTRAFORCE is one of the fastest-growing workforce solutions firms in the United States. As a diversity-owned business, we place human connection at the heart of everything we do, building strong relationships with both clients and candidates to fill roles successfully. Our teams in North and Central America and India serve more than 150 Fortune clients globally, leveraging custom AI technology to provide direct hire, executive search, nearshoring, offshoring, and project staffing solutions.
 
Benefits: SPECTRAFORCE offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE provides unpaid leave as well as paid sick leave when required by law.

Equal Opportunity Employer: SPECTRAFORCE is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.
 
California Applicant Notice: SPECTRAFORCE is committed to complying with the California Privacy Rights Act (“CPRA”) effective January 1, 2023; and all data privacy laws in the jurisdictions in which it recruits and hires employees. A Notice to California Job Applicants Regarding the Collection of Personal Information can be located on our website. Applicants with disabilities may access this notice in an alternative format by contacting NAHR@spectraforce.com.
 
LA County, CA Applicant Notice: If you are selected for this position with SPECTRAFORCE, your offer is contingent upon the satisfactory completion of several requirements, including but not limited to, a criminal background check. We consider qualified applicants with arrest or conviction records for employment in accordance with all local ordinances and state laws, including the Los Angeles County Fair Chance Ordinance for Employers (FCO) and the California Fair Chance Act (FCA). The background check assessment will consider whether a criminal history could reasonably have a direct, adverse impact on the job-related safety, security, trust, regulatory compliance, or suitability for this role. Such findings may result in withdrawal of a conditional job offer. 


At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $50.00/hr.