AI Content Reviewer (Remote)

About the role

We are looking for a meticulous AI Content Reviewer to evaluate and improve AI‑generated outputs across text, image descriptions, and code. Working remotely, you will ensure that content meets accuracy, clarity, factual integrity, brand alignment, and safety standards.

Key responsibilities

• Review AI‑generated text, image captions, and code for relevance, toxicity, bias, and factual correctness.
• Create high‑quality training datasets by labeling data according to strict guidelines.
• Audit the work of junior reviewers or automated systems to maintain consistency with project rubrics.
• Collaborate with operations teams to refine style guides and annotation instructions.
• Identify recurring model errors and provide detailed feedback to data scientists and engineers.
• Monitor basic metrics such as Inter‑Agreement Rates and F1 scores to gauge impact on model performance.

Required profile

• Minimum 2 years experience in content review, moderation, fact‑checking, or quality assurance within tech or digital media.
• Strong analytical ability to make reasoned judgments under ambiguous guidelines.
• Comfort handling potentially sensitive or disturbing content with professionalism.
• Experience testing or providing feedback on generative AI models (e.g., ChatGPT, Bard, Midjourney).
• Background in linguistics, data annotation, or computational linguistics is a plus.
• Ability to thrive in a fast‑paced, evolving environment.

Required skills

• Generative AI models (ChatGPT, Bard, Midjourney)
• Data annotation tools
• Spreadsheets
• Inter‑Agreement Rate and F1‑score analysis