AI Conversation Research, Evaluation Specialist

• Review AI conversations involving real-world interpersonal situations and everyday decision-making
• Identify missing context and recommend relevant follow-up questions to improve AI responses
• Evaluate whether additional information would materially change an AI-generated recommendation
• Distinguish decision-relevant information from non-essential or descriptive details
• Conduct qualitative reviews and document findings using structured evaluation guidelines
• Assess personal, psychological, social, financial, practical, and organizational factors in conversations
• Identify missed opportunities for clarification, deeper understanding, and information gathering
• Review conversations involving relationships, work, education, family, wellbeing, planning, and resource constraints
• Collaborate with research teams on consistent, evidence-based assessments
• Maintain accuracy, clarity, and consistency while meeting project deadlines

• At least 3–5 years of relevant direct professional experience in one or more listed domains
• Licensed Social Work pathway: Master's degree in Social Work (MSW) or equivalent graduate-level qualification
• Licensed Social Work pathway: LCSW, LICSW, LMSW, or equivalent applicable social work license or credential
• Licensed Social Work pathway: Experience in client assessment, case review, interviewing, counseling, or related social-work practice
• Counseling, Therapy, or Psychology pathway: Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy license or credential; or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
• Counseling, Therapy, or Psychology pathway: Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work
• Qualitative Research, HCI, or Communication pathway: MA, PhD, or equivalent advanced expertise in a related discipline
• Qualitative Research, HCI, or Communication pathway: Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding
• Ability to analyze conversations systematically and identify missing context, communication patterns, and opportunities for clarification
• Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields pathway: Relevant professional qualification, credential, or demonstrated subject-matter expertise
• At least 5 years of direct advisory or client-facing experience for candidates qualifying through the advisory pathway
• Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work
• Demonstrated ability to gather context, understand individual or organizational needs, and provide informed recommendations