Alibaba DAMO's HoloCT fuses CT reading and 3D segmentation in one model, surpassing all four radiologists in sensitivity and overall accuracy in a multicentre reader study
Alibaba DAMO Academy's HoloCT is a 3D CT foundation model that puts scan interpretation and voxel-level segmentation inside one vision–language model, so a textual finding can come with a checkable 3D mask. Previously, segmentation networks delineated without interpreting, and CT vision–language models wrote text without voxel-level localization. On 11,455 clinical CT scans from five hospitals, HoloCT-8B raised mean Dice over VoxTell from 0.107 to 0.488 on laryngeal lesions and from 0.543 to 0.715 on lung cancer, and in retrospective reader studies of thyroid tumours and colon lesions it exceeded all four participating radiologists in sensitivity and overall accuracy.