A new dataset for measuring the performance of blood vessel segmentation methods under distribution shifts
PLOS One · 2025
DOI: 10.1371/journal.pone.0322048 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2025. Verfasst von Matheus Viana da Silva und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Federal University of S ao Carlos, São Carlos, Brazil. Hauptthemen laut MEDLINE: Blood Vessels, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundação de Amparo à Pesquisa do Estado de São Paulo, Google Research, Government of Canada’s New Frontiers in Research Fund.
Abstract (Originalsprache)
Creating a dataset for training supervised machine learning algorithms can be a demanding task. This is especially true for blood vessel segmentation since one or more specialists are usually required for image annotation, and creating ground truth labels for just a single image can take up to several hours. In addition, it is paramount that the annotated samples represent well the different conditions that might affect the imaged tissues as well as possible changes in the image acquisition process. This can only be achieved by considering samples that are typical in the dataset as well as atypical, or even outlier, samples. We introduce VessMAP, an annotated and highly heterogeneous blood vessel segmentation dataset acquired by carefully sampling relevant images from a large non-annotated dataset containing fluorescence microscopy images. Each image of the dataset contains metadata information regarding the contrast, amount of noise, density, and intensity variability of the vessels. Prototypical and atypical samples were carefully selected from the base dataset using the available metadata information, thus defining an assorted set of images that can be used for measuring the performance of segmentation algorithms on samples that are highly distinct from each other. We show that datasets traditionally used for developing new blood vessel segmentation algorithms tend to have low heterogeneity. Thus, neural networks trained on as few as four samples can generalize well to all other samples. In contrast, the training samples used for the VessMAP dataset can be critical to the generalization capability of a neural network. For instance, training on samples with good contrast leads to models with poor inference quality. Interestingly, while some training sets lead to Dice scores as low as 0.59, a careful selection of the training samples results in a Dice score of 0.85. Thus, the VessMAP dataset can be used for the development of new active learning methods for selecting relevant samples for manual annotation as well as for analyzing the robustness of segmentation models to distribution shifts of the data.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Computer Science, Federal University of S ao Carlos, São Carlos, Brazil.
- São Carlos Institute of Physics, University of São Paulo, São Carlos, Brazil.
- Department of Cellular and Molecular Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Canada.
- Neuroscience Program, Ottawa Hospital Research Institute, Ottawa, Canada.
ORCID-Profile: Matheus Viana da Silva, Natália de Carvalho Santos
Förderung
- Fundação de Amparo à Pesquisa do Estado de São Paulo
- Google Research
- Government of Canada’s New Frontiers in Research Fund
Zitieren
APA
Viana da Silva, M., de Carvalho Santos, N., Ouellette, J., Lacoste, B., & Comin, C. H. (2025). A new dataset for measuring the performance of blood vessel segmentation methods under distribution shifts. PLOS One. https://doi.org/10.1371/journal.pone.0322048
Vancouver
Viana da Silva M, de Carvalho Santos N, Ouellette J, Lacoste B, Comin CH. A new dataset for measuring the performance of blood vessel segmentation methods under distribution shifts. PLOS One. 2025. doi:10.1371/journal.pone.0322048
BibTeX
@article{VianadaSilva2025,
author = {Viana da Silva, Matheus and de Carvalho Santos, Natália and Ouellette, Julie and Lacoste, Baptiste and Comin, Cesar H},
title = {A new dataset for measuring the performance of blood vessel segmentation methods under distribution shifts},
journal = {PLOS One},
year = {2025},
doi = {10.1371/journal.pone.0322048}
}
EUVIMED