Handling dataset dependence with model ensembles for skin lesion classification from dermoscopic and clinical images
International Journal of Imaging Systems and Technology · 2023-03 · 33 (2) · 556-571
DOI: 10.1002/ima.22827 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Imaging Systems and Technology, online erschienen am 24.11.2022. Verfasst von Ellák Somfai und 7 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Social Fund, Nemzeti Kutatási Fejlesztési és Innovációs Hivatal.
Abstract (Originalsprache)
Dataset dependence affects many real‐life applications of machine learning: the performance of a model trained on a dataset is significantly worse on samples from another dataset than on new, unseen samples from the original one. This issue is particularly acute for small and somewhat specific databases in medical applications; the automated recognition of melanoma from skin lesion images is a prime example. We document dataset dependence in dermoscopic skin lesion image classification using three publicly available medium size datasets. Standard machine learning techniques aimed at improving the predictive power of a model might enhance performance slightly, but the gain is small, the dataset dependence is not reduced, and the best combination depends on model details. We demonstrate that simple differences in image statistics account for only 5% of the dataset dependence. We suggest a solution with two essential ingredients: using an ensemble of heterogeneous models, and training on a heterogeneous dataset. Our ensemble consists of 29 convolutional networks, some of which are trained on features considered important by dermatologists; the networks' output is fused by a trained committee machine. The combined International Skin Imaging Collaboration dataset is suitable for training, as it is multi‐source, produced by a collaboration of a number of clinics over the world. Building on the strengths of the ensemble, it is applied to a related problem as well: recognizing melanoma based on clinical (non‐dermoscopic) images. This is a harder problem as both the image quality is lower than those of the dermoscopic ones and the available public datasets are smaller and scarcer. We explored various training strategies and showed that 79% balanced accuracy can be achieved for binary classification averaged over three clinical datasets.
Förderung
- European Social Fund
- Nemzeti Kutatási Fejlesztési és Innovációs Hivatal
Zitieren
APA
Somfai, E., Baffy, B., Fenech, K., Hosszú, R., Korózs, D., Pólik, M., Sárdy, M., & Lőrincz, A. (2023). Handling dataset dependence with model ensembles for skin lesion classification from dermoscopic and clinical images. International Journal of Imaging Systems and Technology, 33(2), 556-571. https://doi.org/10.1002/ima.22827
Vancouver
Somfai E, Baffy B, Fenech K, Hosszú R, Korózs D, Pólik M, et al. Handling dataset dependence with model ensembles for skin lesion classification from dermoscopic and clinical images. International Journal of Imaging Systems and Technology. 2023;33(2):556-571. doi:10.1002/ima.22827
BibTeX
@article{Somfai2023,
author = {Somfai, Ellák and Baffy, Benjámin and Fenech, Kristian and Hosszú, Rita and Korózs, Dorina and Pólik, Marcell and Sárdy, Miklós and Lőrincz, András},
title = {Handling dataset dependence with model ensembles for skin lesion classification from dermoscopic and clinical images},
journal = {International Journal of Imaging Systems and Technology},
year = {2023},
volume = {33},
number = {2},
pages = {556--571},
doi = {10.1002/ima.22827}
}
EUVIMED