Job Title: Responsible AI Scientist
Duration: 12 Months
Location: Seattle, WA (Candidates will work mostly remote but need to be local to Seattle office to go in as needed)
 
Job Summary
We are seeking a highly skilled and motivated Data Scientist to join our Responsible AI team. In this role, you will be responsible for designing, coordinating, supporting, and executing evaluations of large language model (LLM) features to ensure their safety, fairness, and alignment.
 
You will work closely with multidisciplinary teams, including Research Scientists, Product Managers, Engineers, and other Data Scientists, to drive human-centric evaluations that inform product decisions and improve model performance.
 
This position requires a combination of strong technical skills, experience in industry settings, and a deep understanding of human-centered data science. Familiarity with responsible AI principles and practices is a strong plus.
 
Key Responsibilities

• Design, implement, support, and evaluate experiments for LLM feature safety, including both human and automated evaluations.
• Develop scalable pipelines and tools to process and analyze heterogenous datasets.
• Collaborate with cross-functional teams to operationalize research findings
• Write high-quality, maintainable code, and contribute to shared codebases
• Create and maintain documentation for research processes and evaluation frameworks.
• Communicate findings effectively through presentations and reports, translating technical results into actionable insights for diverse audiences.

 
Key Qualifications

• Strong programming skills in Python, with experience in writing production-level code and implementing best practices (e.g., unit testing, version control).
• Experience with data engineering, including working with large datasets or heterogenous datasets with mixed provenance.
• Solid understanding of machine learning concepts, particularly related to LLMs, NLP, and model evaluation.
• Experience designing and executing experiments, including human-centered evaluations and automated benchmarking.
• Experience in observational or experimental research with human subjects.
• Familiarity with SQL for data manipulation and analysis.
• Strong analytical and problem-solving skills, with experience applying statistical methods to real-world problems.
• Excellent verbal and written communication skills, with experience in explaining technical concepts to non-technical stakeholders.

 
Strongly Preferred

• Hands-on, technical experience solving data science or ML problems with LLMs, preferably in an applied industry context
• Experience with responsible AI, including fairness, transparency, and safety in AI systems.
• Background in human-centered data science, HCI, or social science fields relevant to understanding human-AI interactions or measuring human-centered phenomena.

 
Education
Master’s or PhD in Computer Science, Machine Learning, Data Science, Statistics, Cognitive Science, Psychology, Human-Computer Interaction, or a related field. 

About Us: Established in 2004, SPECTRAFORCE® is one of the largest and fastest-growing diversity-owned staffing firms in the US. The growth of our company is a direct result of our global client service delivery model that is powered by our state-of-the-art A.I. proprietary talent acquisition platform, robust ISO 9001:2015/ISO 27001 certified processes, and strong and passionate client engaged teams. We have built our business by providing talent and project-based solutions, including Contingent, Permanent, and Statement of Work (SOW) services to over 140 clients in the US, Canada, Puerto Rico, Costa Rica, and India. Key industries that we service include Technology, Financial Services, Life Sciences, Healthcare, Telecom, Retail, Utilities and Transportation. SPECTRAFORCE is built on a concept of “human connection,” defined by our branding attitude of NEWJOBPHORIA®, which is the excitement of bringing joy and freedom to the work lifestyle so our people and clients can reach their highest potential. Learn more at: http://www.spectraforce.com
 
Benefits: SPECTRAFORCE offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE provides unpaid leave as well as paid sick leave when required by law.

Equal Opportunity Employer: SPECTRAFORCE is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.
 
California Applicant Notice: SPECTRAFORCE is committed to complying with the California Privacy Rights Act (“CPRA”) effective January 1, 2023; and all data privacy laws in the jurisdictions in which it recruits and hires employees. A Notice to California Job Applicants Regarding the Collection of Personal Information can be located on our website. Applicants with disabilities may access this notice in an alternative format by contacting NAHR@spectraforce.com.
 
LA County, CA Applicant Notice: If you are selected for this position with SPECTRAFORCE, your offer is contingent upon the satisfactory completion of several requirements, including but not limited to, a criminal background check. We consider qualified applicants with arrest or conviction records for employment in accordance with all local ordinances and state laws, including the Los Angeles County Fair Chance Ordinance for Employers (FCO) and the California Fair Chance Act (FCA). The background check assessment will consider whether a criminal history could reasonably have a direct, adverse impact on the job-related safety, security, trust, regulatory compliance, or suitability for this role. Such findings may result in withdrawal of a conditional job offer. 


At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $90.00/hr.