Multidimensional Analysis of the Diagnostic Performance of Machine Learning Models in Disease Classification: Implications for Clinical Decision Support Systems
IEEE Access · 2026 · 14 · 92149-92177
DOI: 10.1109/access.2026.3703248 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Michał Młodawski und 6 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Centre for Research and Development through the INFOSTRATEG Strategic Program, Competition: INFOSTRATEG IV.
Abstract (Originalsprache)
Clinical decision support systems face a fundamental challenge in the form of incomplete medical data. This study presents a methodology for designing an expert system for classifying disease entities according to ICD-10. The system operates under conditions of incomplete clinical data and diagnostic uncertainty. A total of 1,655 clinical cases from internal medicine (n = 616) and pediatrics (n = 1,039) were analyzed. Nineteen classification algorithms were compared. A two-stage diagnostic model (TOP-1 and TOP-3), reflecting clinical practice, was applied. The main hypothesis assumed that machine learning algorithms can effectively compensate for diagnostic uncertainty through mechanisms of differential diagnosis. In internal medicine, Gradient Boosting achieved the highest performance (84.74% accuracy), whereas in pediatrics the Multi-Layer Perceptron performed best (87.20% accuracy). Pediatrics demonstrated higher overall performance (mean TOP-3: 81.99%) than internal medicine (77.43%). The TOP-3 mechanism ensured a probability of identifying the correct diagnosis exceeding 94% in pediatrics and 91% in internal medicine, which substantially enhances the clinical safety of the system. The identification of different optimal algorithms for each specialty confirms the need to tailor modeling strategies to the clinical context. On external validation on 120 cases from a separate facility, treated as the primary benchmark of real-world performance, TOP-1 accuracy was 73.33% (internal medicine) and 78.33% (pediatrics), with TOP-3 accuracy of 86.67% and 90.00% respectively, and SHAP and LIME confirming clinically relevant predictions. The TOP-3 methodology developed constitutes an important contribution to the design of decision support systems under limited data availability.
Förderung
- National Centre for Research and Development through the INFOSTRATEG Strategic Program, Competition: INFOSTRATEG IV
Zitieren
APA
Młodawski, M., Deniziak, S., Płaza, M., Kwiatkowska, A., Jaszczyk, D., Gajda, A., & Twardowski, K. (2026). Multidimensional Analysis of the Diagnostic Performance of Machine Learning Models in Disease Classification: Implications for Clinical Decision Support Systems. IEEE Access, 14, 92149-92177. https://doi.org/10.1109/access.2026.3703248
Vancouver
Młodawski M, Deniziak S, Płaza M, Kwiatkowska A, Jaszczyk D, Gajda A, et al. Multidimensional Analysis of the Diagnostic Performance of Machine Learning Models in Disease Classification: Implications for Clinical Decision Support Systems. IEEE Access. 2026;14:92149-92177. doi:10.1109/access.2026.3703248
BibTeX
@article{Modawski2026,
author = {Młodawski, Michał and Deniziak, Stanisław and Płaza, Mirosław and Kwiatkowska, Aleksandra and Jaszczyk, Dawid and Gajda, Arkadiusz and Twardowski, Karol},
title = {Multidimensional Analysis of the Diagnostic Performance of Machine Learning Models in Disease Classification: Implications for Clinical Decision Support Systems},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {92149--92177},
doi = {10.1109/access.2026.3703248}
}
EUVIMED