VISTA-PATH：面向计算病理学的病理图像分割与定量分析交互式基础模型

摘要

精准的病理图像语义分割对于定量组织分析及下游临床建模至关重要。现有的分割基础模型通过大规模预训练提升了泛化能力，但由于将分割视为静态视觉预测任务，仍与病理学需求存在偏差。本文提出VISTA-PATH——一个支持交互的类别感知病理分割基础模型，能够解析异质性结构、整合专家反馈，并生成对临床诊断具有直接意义的像素级分割结果。VISTA-PATH通过联合建模视觉上下文、语义组织描述及可选的专家空间提示，实现跨异质性病理图像的精确实时多类分割。为支撑该范式，我们构建了VISTA-PATH数据集，这是一个包含超过160万张图像-掩码-文本三元组的大规模病理分割语料库，涵盖9个器官和93种组织类型。在大量预留测试集和外部基准上的实验表明，VISTA-PATH持续优于现有分割基础模型。值得注意的是，该模型支持动态人机协同优化，可将稀疏的局部边界框标注反馈传播至全玻片分割。最终我们证明，VISTA-PATH产生的高保真类别感知分割是计算病理学的优选模型，其通过提出的肿瘤相互作用评分（TIS）提升肿瘤微环境分析能力，该评分与患者生存期呈现显著相关性。这些成果共同确立了VISTA-PATH作为基础模型的价值，将病理图像分割从静态预测提升为面向数字病理的交互式临床表征。源代码及演示见https://github.com/zhihuanglab/VISTA-PATH。

English

Accurate semantic segmentation for histopathology image is crucial for quantitative tissue analysis and downstream clinical modeling. Recent segmentation foundation models have improved generalization through large-scale pretraining, yet remain poorly aligned with pathology because they treat segmentation as a static visual prediction task. Here we present VISTA-PATH, an interactive, class-aware pathology segmentation foundation model designed to resolve heterogeneous structures, incorporate expert feedback, and produce pixel-level segmentation that are directly meaningful for clinical interpretation. VISTA-PATH jointly conditions segmentation on visual context, semantic tissue descriptions, and optional expert-provided spatial prompts, enabling precise multi-class segmentation across heterogeneous pathology images. To support this paradigm, we curate VISTA-PATH Data, a large-scale pathology segmentation corpus comprising over 1.6 million image-mask-text triplets spanning 9 organs and 93 tissue classes. Across extensive held-out and external benchmarks, VISTA-PATH consistently outperforms existing segmentation foundation models. Importantly, VISTA-PATH supports dynamic human-in-the-loop refinement by propagating sparse, patch-level bounding-box annotation feedback into whole-slide segmentation. Finally, we show that the high-fidelity, class-aware segmentation produced by VISTA-PATH is a preferred model for computational pathology. It improve tissue microenvironment analysis through proposed Tumor Interaction Score (TIS), which exhibits strong and significant associations with patient survival. Together, these results establish VISTA-PATH as a foundation model that elevates pathology image segmentation from a static prediction to an interactive and clinically grounded representation for digital pathology. Source code and demo can be found at https://github.com/zhihuanglab/VISTA-PATH.

VISTA-PATH：面向计算病理学的病理图像分割与定量分析交互式基础模型

VISTA-PATH: An interactive foundation model for pathology image segmentation and quantitative analysis in computational pathology

摘要

Support