EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation Boundaries in Multimodal Skin Lesion Classification: Data Leakage, Patient Reuse, and Cross-Release Overlap

Haseeb Ali Khan, Sitara Afzal, Jong-Ha Lee

Mathematics · 19.11.2026 · 14 (22) · 4264

DOI: 10.3390/math14224264 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 19.11.2026. Verfasst von Haseeb Ali Khan und 2 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Health and Welfare, Ministry of SMEs and Startups, Ministry of Education.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal skin-lesion classifiers combine dermoscopic images with clinical metadata, but reported gains may depend on how related images, lesions, patients, and dataset releases are separated between model development and testing. This study evaluates how these boundaries affect classification performance and the measured benefit of metadata fusion. HAM10000, PAD-UFES-20, and International Skin Imaging Collaboration (ISIC) releases are assessed using image-level, lesion-level, patient-level, content-based, and cross-release protocols. Image-only, metadata-only, late-fusion, metadata-gated, and cross-attention models are compared under matched settings with repeated seeds and confidence intervals. In HAM10000, with a fine-tuned ConvNeXt-Small encoder, random image-level splitting increased the macro-averaged F1 score (macro-F1) by 9.48 percentage points relative to lesion-disjoint evaluation, whereas cross-attention changed macro-F1 by only −0.34, −0.86, and +1.11 points across the tested protocols. On PAD-UFES-20, 32.22–40.46% of test patients under lesion-disjoint evaluation were also represented in training through different lesions, and cross-attention macro-F1 was 0.8085 under lesion-disjoint and 0.7124 under patient-disjoint evaluation. Retaining shared HAM10000 identities, and thereby their acquisition source, in the ISIC 2019 model-development pool was associated with an 18.2-point macro-F1 difference. For the datasets and models tested, evaluation boundaries produced larger macro-F1 changes than the fusion methods, highlighting the need to align the separation unit with the intended generalization target.

Förderung

  • Ministry of Health and Welfare
  • Ministry of SMEs and Startups
  • Ministry of Education
  • Ministry of Science and ICT

Zitieren

APA

Khan, H. A., Afzal, S., & Lee, J. (2026). Evaluation Boundaries in Multimodal Skin Lesion Classification: Data Leakage, Patient Reuse, and Cross-Release Overlap. Mathematics, 14(22), 4264. https://doi.org/10.3390/math14224264

Vancouver

Khan HA, Afzal S, Lee J. Evaluation Boundaries in Multimodal Skin Lesion Classification: Data Leakage, Patient Reuse, and Cross-Release Overlap. Mathematics. 2026;14(22):4264. doi:10.3390/math14224264

BibTeX
@article{Khan2026,
  author = {Khan, Haseeb Ali and Afzal, Sitara and Lee, Jong-Ha},
  title = {Evaluation Boundaries in Multimodal Skin Lesion Classification: Data Leakage, Patient Reuse, and Cross-Release Overlap},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {22},
  pages = {4264},
  doi = {10.3390/math14224264}
}
Kostenlos starten →