AI Policy Reviewer (Remote)

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance checkpoint, safeguarding model integrity by identifying safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify and document edge cases where policy interpretation is ambiguous, including over‑sensitive or under‑sensitive outcomes.
• Analyze data to uncover systematic flaws such as bias, hallucinations, or policy gaps and report findings to Product and Engineering teams.
• Collaborate with Policy teams to refine evaluation rubrics and test their teachability to AI models.
• Participate in adversarial testing (red‑team) to provoke unsafe responses and help improve model robustness.
• Work closely with Machine Learning Engineers, explaining rating decisions to guide model adjustments.
• Create high‑quality prompt‑response examples that serve as “golden sets” for training.

Required profile

• Minimum 3 years of experience in Trust & Safety, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep knowledge of content moderation policies covering hate speech, harassment, misinformation, and graphic violence.
• Strong analytical ability to deconstruct AI outputs, detect logical flaws, hallucinations, and subtle biases.
• Excellent written communication skills to explain findings to engineers and policy experts.
• Emotional resilience and self‑care strategies for exposure to disturbing content.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Proficiency with dashboards and spreadsheet tools.
• Experience using specialized content review platforms.