Quality Evaluator – Fluent English

• Interact with different AI models and tools across a wide range of prompts and topics
• Compare two or more AI-generated responses side by side
• Assess accuracy, helpfulness, instruction-following, clarity, and overall response quality
• Follow detailed rating guidelines and multi-step evaluation workflows
• Write clear, well-reasoned explanations supporting evaluation decisions
• Apply evaluation criteria consistently across tasks

• Fluency in English, with strong reading comprehension and writing skills
• Extensive hands-on experience using LLMs and critically assessing their outputs
• Strong analytical judgment and ability to weigh multiple dimensions of response quality
• Excellent attention to detail and ability to follow complex instructions carefully
• Ability to explain evaluation decisions clearly and convincingly
• Comfort switching between AI models, tools, and multi-step workflows
• Previous experience in AI response evaluation, data annotation, or quality assurance (nice to have)
• Experience in editing, research, fact-checking, or analytical writing (nice to have)
• Familiarity with evaluation rubrics and side-by-side comparison tasks (nice to have)

• Remote work
• Part-time schedule
• Independent contractor arrangement
• Up to 3 months of commitment