AI Rater Guidelines Writer (Linguist / Instructional Designer)

Join a leading AI lab’s cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.

1. Overview

Join a leading AI lab’s cutting-edge GenAI team and help build foundational AI models from the ground up. We’re seeking talented Linguists and Instructional Designers with deep experience translating ambiguous program requirements into clear, unambiguous rater guidelines to bring precision and consistency to our AI training data — working across domains from finance and retail to insurance, legal, and sports.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.

2. Key Responsibilities

• Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across a range of subject-matter domains.

• Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.

• Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.

• Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.

• Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

3. Core Qualifications

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.

• Demonstrated ability to work across multiple subject-matter domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuance into clear, unambiguous instructions.

• Strong track record of resolving ambiguity and contradiction in written specifications — able to point to concrete before/after examples.

• Demonstrable career progression.

• Ability to engage reliably for at least 35 hours/week during weekdays.

• Strong written communication skills and the ability to explain complex or nuanced guidance clearly and precisely.

About Cincinnatus LLC:
Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.

Equal Employment Opportunity:
Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.