AI Coding Evaluator

• Evaluate the technical accuracy, language quality, and usefulness of AI-generated responses
• Review AI-generated customer service responses and technical content
• Evaluate responses for clarity, helpfulness, natural language, and overall quality
• Assess technical correctness using coding knowledge
• Read, validate, and troubleshoot JSON, identifying structural and formatting issues
• Check outputs for formatting accuracy and adherence to project guidelines
• Provide clear, well-reasoned feedback explaining evaluations
• Complete a natural, spontaneous voice response of up to one minute

• Fluency in one or more supported language varieties: Dutch (Netherlands), Welsh (United Kingdom), French (Canada), German (Germany), Italian (Italy), Portuguese (Brazil), or Greek (Greece)
• Solid understanding of JSON, including syntax, structure, validation, and troubleshooting
• Coding knowledge sufficient to assess technical content and identify errors
• Strong judgment when evaluating customer service responses
• Excellent attention to detail and strong written communication skills
• Ability to follow detailed evaluation guidelines consistently
• Previous experience in AI evaluation, quality assurance, or technical support is nice to have
• Experience working with APIs and structured data is nice to have
• Background in customer service, software development, or technical writing is nice to have

• Independent contractor arrangement
• Part-time work
• Project duration of up to 3 months