Head-to-Head Evaluation of the Cancer Ontology Supervised Multimodal Orchestration (COSMO) AI System Versus Pathologist-Only Review

Part of paid clinical trials in Boston, Massachusetts.

Sponsor
Harvard Medical School (HMS and HSDM)
Study ID
NCT07307157
Status
Enrolling By Invitation

Conditions

Eligibility Criteria

Sex
ALL
Age
N/A - N/A
Healthy Volunteers
Not accepted

Interventions

  • Digital Pathology Evaluation — DIAGNOSTIC_TEST
    Digital Pathology Evaluation

Study Details

This study evaluates the diagnostic performance of the Cancer Ontology Supervised Multimodal Orchestration (COSMO) AI system for cancer subtype classification and compares it head-to-head with pathologist-only review. Pathologists will independently review de-identified whole-slide images derived from up to 300 patients across three anatomical sites (brain, lung, kidney) and provide diagnostic assessments. In parallel, COSMO will process the same cases offline to generate independent predictions, enabling direct comparison of diagnostic accuracy between human experts and the AI system. The study will characterize the diagnostic accuracy of COSMO and pathologists, inter-observer agreement, and variations in performance across anatomical sites and cancer types with different incidence rates. Results will establish how COSMO compares to pathologists on identical cases and will inform the development of AI-assisted diagnostic systems in clinical practice.

Key Dates

Start date
Jun 12, 2025
Status verified
Dec 2025
Primary completion
Jan 31, 2026
Completion
Jan 31, 2026

Study Design

Enrollment
30 participants (estimated)

Arms

  • Arm: AI-Based Evaluation using COSMO
  • Arm: Pathologist-Based Evaluation

Primary Outcome Measure

Diagnostic performance [ Time Frame: Periprocedural (at the time of slide review) ]

Locations (1)

FacilityCityStateZIPSite coordinators
Harvard Medical SchoolBostonMassachusetts02115-

Find similar trials in Boston, MA

Related Studies