Role Overview\nThe Generalist Reviewer is responsible for evaluating task submissions used in research and large language model (LLM) training. This role focuses on quality assurance, guideline fidelity, and structured feedback, ensuring that submitted work meets defined standards for accuracy, clarity, safety, and compliance.\nGeneralist Reviewers apply consistent judgment across a wide range of task types and domains, relying on documented rubrics rather than personal preference. This role is ideal for professionals with experience in quality review, auditing, evaluation, compliance, instructional assessment, or editorial QA.\n\nKey Responsibilities\n- Review task submissions against detailed written guidelines, rubrics, and policy requirements\n- Assess work for:\n-- Accuracy and completeness\n-- Adherence to task instructions\n-- Compliance with safety, privacy, and content standards\n-- Internal consistency and logical reasoning\n- Identify errors, omissions, and guideline deviations with precision\n- Provide clear, actionable, and professional written feedback to contributors\n- Apply evaluation standards consistently across high volumes of work\n- Flag potential compliance, safety, or integrity issues promptly\n- Document review decisions in required systems with appropriate rationale\n- Maintain confidentiality and data handling standards at all times\n\nRequired Qualifications\n- Bachelor’s degree or equivalent professional experience\n- 3+ years of experience in one or more of the following:\n-- Quality assurance or quality control\n-- Content review or editorial evaluation\n-- Compliance, audit, or policy enforcement\n-- Instructional design review or assessment scoring\n- Demonstrated ability to follow complex written guidelines precisely\n- Strong written communication skills with a professional, neutral tone\n- High attention to detail and consistency\n- Ability to make objective decisions under ambiguity\n\nPreferred Qualifications\n- Experience reviewing work for research, training data, or evaluation programs\n- Familiarity with rubric-based scoring or structured evaluation frameworks\n- Background in trust & safety, content moderation, or regulated industries\n- Experience working with confidential or sensitive information\n\nKey Competencies\n- Judgment and consistency\n- Written feedback quality\n- Compliance awareness\n- Time management and reliability\n- Professional discretion\n\nExpectations \n- Strict adherence to confidentiality and data protection requirements\n- Consistent application of guidelines across all reviews\n- Willingness to update evaluation approach as standards evolve\n- Professional, unbiased, and respectful communication at all times\n\nLogistics \n- Pay range: $80/hour\n- Employment type: Contract, flexible hours (part-time and full-time options).\n- Location requirements: Remote (U.S. and Canada only)