Software Dev Engineer II
Spectraforce
Bellevue, Washington
17 days ago
Job Description
Job Title: Data Quality SDE
Duration: 9 months
Location: Bellevue, WA
Company Overview: Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape.
Job Description: As a Data Quality SDE, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.
Key job responsibilities
This role requires a unique blend of technical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world coding applications. Your work will directly influence the development of next-generation AI coding assistants, shaping the future of software development.
If you're passionate about code quality, have a keen eye for detail, and are excited about the potential of AI in software engineering, we encourage you to apply for this pivotal role at AGI Data Services.
About Us: SPECTRAFORCE is one of the fastest-growing workforce solutions firms in the United States. As a diversity-owned business, we place human connection at the heart of everything we do, building strong relationships with both clients and candidates to fill roles successfully. Our teams in North and Central America and India serve more than 150 Fortune clients globally, leveraging custom AI technology to provide direct hire, executive search, nearshoring, offshoring, and project staffing solutions.
Benefits: SPECTRAFORCE offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE provides unpaid leave as well as paid sick leave when required by law.
Equal Opportunity Employer: SPECTRAFORCE is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.
California Applicant Notice: SPECTRAFORCE is committed to complying with the California Privacy Rights Act (“CPRA”) effective January 1, 2023; and all data privacy laws in the jurisdictions in which it recruits and hires employees. A Notice to California Job Applicants Regarding the Collection of Personal Information can be located on our website. Applicants with disabilities may access this notice in an alternative format by contacting NAHR@spectraforce.com.
LA County, CA Applicant Notice: If you are selected for this position with SPECTRAFORCE, your offer is contingent upon the satisfactory completion of several requirements, including but not limited to, a criminal background check. We consider qualified applicants with arrest or conviction records for employment in accordance with all local ordinances and state laws, including the Los Angeles County Fair Chance Ordinance for Employers (FCO) and the California Fair Chance Act (FCA). The background check assessment will consider whether a criminal history could reasonably have a direct, adverse impact on the job-related safety, security, trust, regulatory compliance, or suitability for this role. Such findings may result in withdrawal of a conditional job offer.
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $60.00/hr.
Duration: 9 months
Location: Bellevue, WA
Company Overview: Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape.
Job Description: As a Data Quality SDE, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.
Key job responsibilities
- Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
- Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
- Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs
- Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency
- Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
- Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
- Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge
- Advanced degree in Computer Science, Software Engineering, or a related field
- Please note: Bachelor degree works too, as long as they have 3+ years software development experience
- Extensive experience (3+ years) in software development across multiple programming languages and paradigms
- Demonstrated ability to critically evaluate code quality, efficiency, and adherence to best practices
- Strong analytical and decision-making skills, with the ability to make complex judgments under ambiguous circumstances
- Excellent written and verbal communication skills, with the ability to explain technical concepts clearly
- Experience in technical writing, particularly in creating coding examples or tutorials
- Experience in creating or contributing to coding standards or style guides
- Software skills good to have: Git, Docker, Cloud services, Backend or Front end, AI infra
- Java/Python/PythonScript. It's not required to be fluent in all three, but they can read and understand codes in all 3
- Previous experience working with or evaluating AI systems, particularly in the context of code generation
- Familiarity with a wide range of software development methodologies and architectural patterns
- Understanding of machine learning concepts, particularly as they apply to natural language processing and code generation
- Data analysis skills, writing script to analyze model performance against human ground truth
- Intermediate Excel skills (VLOOKUPS, PIVOTS, formulas)
This role requires a unique blend of technical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world coding applications. Your work will directly influence the development of next-generation AI coding assistants, shaping the future of software development.
If you're passionate about code quality, have a keen eye for detail, and are excited about the potential of AI in software engineering, we encourage you to apply for this pivotal role at AGI Data Services.
About Us: SPECTRAFORCE is one of the fastest-growing workforce solutions firms in the United States. As a diversity-owned business, we place human connection at the heart of everything we do, building strong relationships with both clients and candidates to fill roles successfully. Our teams in North and Central America and India serve more than 150 Fortune clients globally, leveraging custom AI technology to provide direct hire, executive search, nearshoring, offshoring, and project staffing solutions.
Benefits: SPECTRAFORCE offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE provides unpaid leave as well as paid sick leave when required by law.
Equal Opportunity Employer: SPECTRAFORCE is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.
California Applicant Notice: SPECTRAFORCE is committed to complying with the California Privacy Rights Act (“CPRA”) effective January 1, 2023; and all data privacy laws in the jurisdictions in which it recruits and hires employees. A Notice to California Job Applicants Regarding the Collection of Personal Information can be located on our website. Applicants with disabilities may access this notice in an alternative format by contacting NAHR@spectraforce.com.
LA County, CA Applicant Notice: If you are selected for this position with SPECTRAFORCE, your offer is contingent upon the satisfactory completion of several requirements, including but not limited to, a criminal background check. We consider qualified applicants with arrest or conviction records for employment in accordance with all local ordinances and state laws, including the Los Angeles County Fair Chance Ordinance for Employers (FCO) and the California Fair Chance Act (FCA). The background check assessment will consider whether a criminal history could reasonably have a direct, adverse impact on the job-related safety, security, trust, regulatory compliance, or suitability for this role. Such findings may result in withdrawal of a conditional job offer.
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $60.00/hr.