Job Title: Research Scientist
Duration: 12 Months
Location: Seattle, WA (Candidates will work mostly remote but need to be local to Seattle office to go in as needed)

Description

• This role is for a Research Scientist who will be responsible for designing and implementing robust processes to evaluate and improve LLM-based models.
• More specifically, they will work on ensuring that we build models that will accelerate the developer work cycle and improve how software is built. 
   

This researcher will:

• Work closely with engineers, PMs, designers, and data scientists to align on research goals and build scalable end-to-end evaluation pipelines.
• Report on their research and make recommendations to stakeholders.
• Work autonomously and mentor other researchers to support the goals of the research organization.

 
Minimum Qualifications

• 4+ years of experience in an applied research setting, or similar.
• Proven experience developing benchmarks and metrics to evaluate AI models, preferably with a focus on code generation or natural language processing (NLP).
• Familiarity with software engineering principles (unit tests, CI/CD, version control etc.).
• Strong programming skills in 1 or more programming languages (including Python).
• 2 years or more of experience with machine learning and data science algorithms and tools (e.g., PyTorch).
• Ability to produce meaningful visualizations and reports, and effectively present results to different audiences and across multiple media formats.
• Ability to work independently as well as collaboratively with minimal direction.
• Organized, highly attentive to detail, and manages time well.
• Experience working in industry.

 
Preferred Qualifications

• Advanced degree (MS/PhD) in data analytics, statistics, or any engineering or computer science field.
• Experience with large language models (LLMs) and knowledge of state-of-the-art code generation techniques.
• Publication(s) in the fields of artificial intelligence, machine learning or data science. 
• Familiarity with code generation-specific benchmarks and metrics.
• Ability to modify or fine-tune pre-trained models for specialized tasks.
• Familiarity with code scanning tools. 

 

About Us: Established in 2004, SPECTRAFORCE® is one of the largest and fastest-growing diversity-owned staffing firms in the US. The growth of our company is a direct result of our global client service delivery model that is powered by our state-of-the-art A.I. proprietary talent acquisition platform, robust ISO 9001:2015/ISO 27001 certified processes, and strong and passionate client engaged teams. We have built our business by providing talent and project-based solutions, including Contingent, Permanent, and Statement of Work (SOW) services to over 140 clients in the US, Canada, Puerto Rico, Costa Rica, and India. Key industries that we service include Technology, Financial Services, Life Sciences, Healthcare, Telecom, Retail, Utilities and Transportation. SPECTRAFORCE is built on a concept of “human connection,” defined by our branding attitude of NEWJOBPHORIA®, which is the excitement of bringing joy and freedom to the work lifestyle so our people and clients can reach their highest potential. Learn more at: http://www.spectraforce.com
 
Benefits: SPECTRAFORCE offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE provides unpaid leave as well as paid sick leave when required by law.

Equal Opportunity Employer: SPECTRAFORCE is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.
 
California Applicant Notice: SPECTRAFORCE is committed to complying with the California Privacy Rights Act (“CPRA”) effective January 1, 2023; and all data privacy laws in the jurisdictions in which it recruits and hires employees. A Notice to California Job Applicants Regarding the Collection of Personal Information can be located on our website. Applicants with disabilities may access this notice in an alternative format by contacting NAHR@spectraforce.com.
 
LA County, CA Applicant Notice: If you are selected for this position with SPECTRAFORCE, your offer is contingent upon the satisfactory completion of several requirements, including but not limited to, a criminal background check. We consider qualified applicants with arrest or conviction records for employment in accordance with all local ordinances and state laws, including the Los Angeles County Fair Chance Ordinance for Employers (FCO) and the California Fair Chance Act (FCA). The background check assessment will consider whether a criminal history could reasonably have a direct, adverse impact on the job-related safety, security, trust, regulatory compliance, or suitability for this role. Such findings may result in withdrawal of a conditional job offer. 


At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $90.00/hr.