Ensembles of Convolutional Neural Networks and Transformers for Polyp Segmentation
Sensors · 2023
DOI: 10.3390/s23104688 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Sensors, 2023. Verfasst von Loris Nanni und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Engineering, University of Padova, 35122 Padova, Italy. Hauptthemen laut MEDLINE: Electric Power Supplies, Knowledge. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In the realm of computer vision, semantic segmentation is the task of recognizing objects in images at the pixel level. This is done by performing a classification of each pixel. The task is complex and requires sophisticated skills and knowledge about the context to identify objects’ boundaries. The importance of semantic segmentation in many domains is undisputed. In medical diagnostics, it simplifies the early detection of pathologies, thus mitigating the possible consequences. In this work, we provide a review of the literature on deep ensemble learning models for polyp segmentation and develop new ensembles based on convolutional neural networks and transformers. The development of an effective ensemble entails ensuring diversity between its components. To this end, we combined different models (HarDNet-MSEG, Polyp-PVT, and HSNet) trained with different data augmentation techniques, optimization methods, and learning rates, which we experimentally demonstrate to be useful to form a better ensemble. Most importantly, we introduce a new method to obtain the segmentation mask by averaging intermediate masks after the sigmoid layer. In our extensive experimental evaluation, the average performance of the proposed ensembles over five prominent datasets beat any other solution that we know of. Furthermore, the ensembles also performed better than the state-of-the-art on two of the five datasets, when individually considered, without having been specifically trained for them.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Information Engineering, University of Padova, 35122 Padova, Italy.
- Department of Information Engineering, University of Brescia, 25121 Brescia, Italy.
- Department of Computer Science and Engineering, University of Bologna, 40126 Bologna, Italy.
ORCID-Profile: Loris Nanni, Carlo Fantozzi, Andrea Loreggia, Alessandra Lumini
Zitieren
APA
Nanni, L., Fantozzi, C., Loreggia, A., & Lumini, A. (2023). Ensembles of Convolutional Neural Networks and Transformers for Polyp Segmentation. Sensors. https://doi.org/10.3390/s23104688
Vancouver
Nanni L, Fantozzi C, Loreggia A, Lumini A. Ensembles of Convolutional Neural Networks and Transformers for Polyp Segmentation. Sensors. 2023. doi:10.3390/s23104688
BibTeX
@article{Nanni2023,
author = {Nanni, Loris and Fantozzi, Carlo and Loreggia, Andrea and Lumini, Alessandra},
title = {Ensembles of Convolutional Neural Networks and Transformers for Polyp Segmentation},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23104688}
}
EUVIMED