AI Evaluation Specialist (Remote Contractor)

About the role

We are looking for an AI Evaluation Specialist to work remotely on a contract basis. In this role you will help train next‑generation AI systems by reviewing and rating AI‑generated content, ensuring high quality and usability.

Key responsibilities

• Review AI‑generated outputs across text, visual and other content types for quality, clarity and user experience.
• Identify inconsistencies, weaknesses and improvement opportunities, applying structured evaluation guidelines.
• Provide nuanced feedback that informs model improvements and training data creation.
• Collaborate with cross‑functional teams to define quality standards, scoring criteria and review processes.
• Maintain high accuracy and consistency in evaluations to deliver reliable, actionable results.
• Contribute to the continuous improvement of evaluation workflows and best practices.

Required profile

• Exceptional reading comprehension and acute attention to detail.
• Strong observational skills with solid aesthetic or editorial judgment.
• Ability to think critically and deliver consistent, high‑quality evaluations in ambiguous scenarios.
• Excellent written and verbal communication skills.
• Comfort working across various content types and evaluation guidelines.
• Strong sense of ownership, reliability and commitment to delivering high‑quality work.
• Open‑minded approach to learning and adapting to new workflows.

Required skills