MSR Project – French Culture Expert

• Identify realistic search-related failures where an AI model provides inadequate responses
• Create and test search queries
• Document what went wrong with AI model responses
• Write instructions and evaluation criteria for correct answers
• Evaluate local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability
• Test multiple queries before finding failures

• Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking — can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• Attention to detail — can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset — comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
• Domain knowledge — ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity — can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge — deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures
• French-speaking expertise
• Availability for 20 hours per week

• Ongoing project
• 20 hours per week commitment