← All jobs

Healthcare Subject Matter Expert – AI Model Evaluation

About the role

• Evaluate AI-generated healthcare information for factual accuracy, completeness, clinical relevance, and consistency with established medical knowledge and guidelines
• Assess AI-generated clinical assessments, differential diagnoses, and treatment-related explanations
• Identify factual errors, unsupported assumptions, missing clinical considerations, and potential patient safety concerns
• Conduct medical research and verify information using peer-reviewed literature, clinical practice guidelines, and established healthcare resources
• Analyze hypothetical patient cases, symptoms, medical histories, laboratory findings, and diagnostic information
• Provide evidence-based feedback and recommend corrections
• Follow project-specific scoring rubrics, annotation instructions, and quality assurance guidelines
• Complete independent evaluation tasks using designated online platforms, including DataCompute
• Meet established deadlines and quality expectations
• Maintain confidentiality and comply with privacy, ethical, and data security requirements

• Current enrollment in the third or fourth year of a recognized medical degree program, an eligible medical internship or residency, or an advanced NP or PA educational program with relevant clinical training
• Relevant academic coursework, clinical rotations, or supervised training in General Practice, Family Medicine, Internal Medicine, Nurse Practitioner practice, or Physician Assistant practice
• Strong understanding of medical terminology, anatomy, physiology, pathology, pharmacology, and relevant clinical concepts
• Ability to assess medical scenarios, interpret clinical information, and distinguish evidence-based reasoning from inaccurate or unsupported conclusions
• Ability to research medical literature, interpret clinical guidelines, and validate findings using authoritative healthcare resources
• Strong analytical reasoning, problem-solving abilities, and attention to detail
• Excellent written English skills
• Comfort working with computers, web-based platforms, digital documentation, and online research tools
• Ability to follow detailed instructions, complete assignments independently, and meet quality requirements
• Willingness to participate in a remote, freelance engagement with project-based assignments and schedules
• Second-year medical students must be enrolled at a top medical school
• Relevant specialty or study track required
• Independent medical licensure and previous employment as a licensed physician, Nurse Practitioner, or Physician Assistant are not required for eligible student-level assignments

• Remote work from an eligible location
• Exposure to AI evaluation, medical content assessment, and evidence-based research
• Opportunity to apply medical education and clinical reasoning to healthcare AI projects
• Variable scheduling, including potential weekday and weekend assignments
• Project-based freelance engagement
• No previous AI background required