EUVIMEDEUVIMED entdecken
Open Access

Automating Diagnosis of Skin Neglected Tropical Diseases via Patient Metadata through Machine Learning Model with Adaptive Balancing and Dual Cross-Validation: Retrospective Diagnostic Accuracy Study

Yohannes Minyilu, Mohammed Abebe Yimer, Million Meshesha

Online Journal of Public Health Informatics · 21.08.2026 · 18 · e84966-e84966

DOI: 10.2196/84966 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Online Journal of Public Health Informatics, online erschienen am 21.08.2026. Verfasst von Yohannes Minyilu und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Computing and Software Engineering, Arba Minch Institute of Technology, Arba Minch University, P.O. Box 21, Arba Minch, Ethiopia, +251 911…. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Skin neglected tropical diseases (NTDs) are the most prevalent diseases worldwide, affecting people living in resource-limited areas with low health care services and trained professionals. While machine learning (ML)–based diagnostic tools can be used for initial clinical assessment and patient screening, especially in resource-limited areas (including in Ethiopia), little effort has been made in this area.

Objective

This pilot study develops a foundational ML model for the diagnosis of skin NTDs using patient metadata to analyze the feasibility of ML-based models for skin NTDs by identifying and experimentally evaluating 8 ML models.

Methods

For this study, we acquired a tabular skin NTD diagnostic dataset collected from a specific affected district in the southwest of Ethiopia. We used the data in 3 different structures, which include using the initial dataset (IDS) that contains huge null values, using a final dataset (FDS) created through preliminary preprocessing, and a third dataset created by applying feature engineering (FEFDS). Selecting 8 ML models, we trained the models in 4 major experimental settings: baseline training, handling structural missing values, handling severe class imbalance through conditional class weighting, and a hybrid approach based on robust dual cross-validation (CV) consisting of an outer repeated stratified k -fold and nested CV methods. We used the macro and class-specific metrics (such as precision, recall, and F 1 -score), including balanced accuracy, due to the severe class imbalance. Feature importance scores are also used for evaluating overall model performance.

Results

After the final training applying the hybrid approach, 4 models scored a perfect test score (1.0) across all the metrics and all experiments except naïve Bayes and multilayer perceptron (MLP), similarly scoring 0.997 balanced accuracy, 0.97 recall, and 0.985 F 1 -score. In the same experiment, the nested CV loop revealed a slight performance drop for light gradient boosting machine (LightGBM) and extreme gradient boosting (XGBoost), though both models similarly maintained higher mean scores of balanced accuracy and macro recall of 0.993 (SD 0.013), including the mean macro F 1 -score of 0.996 (SD 0.007), scoring declining performance with a mean score of 0.993 (SD 0.013) in balanced accuracy, macro recall, and F 1 -score, showing predictive biases. In terms of feature utilization, only CatBoost showed optimal feature ranking, while 4 models showed over-feature utilization (selection bias), with 3 models using small subsets of features (showing feature parsimony).

Conclusions

Overall, this study has been highly challenged by data scarcity, class imbalances, limited disease representation, specific geographic representation, and lack of more data modalities. Hence, further studies are suggested to confirm the results on larger datasets having a representative distribution of disease classes and geographic locations.

Schlagwörter

Stichwörter der Autor:innen

ML modelsclass weightingdual cross-validationfeature importancemachine learningneglected tropical diseasespatient metadataskin NTDs

Autor:innen und Institutionen

  • Faculty of Computing and Software Engineering, Arba Minch Institute of Technology, Arba Minch University, P.O. Box 21, Arba Minch, Ethiopia, +251 911434681.
  • School of Information Science, College of Natural and Computational Sciences, Addis Ababa University, Addis Ababa, Ethiopia.

Zitieren

APA

Minyilu, Y., Yimer, M. A., & Meshesha, M. (2026). Automating Diagnosis of Skin Neglected Tropical Diseases via Patient Metadata through Machine Learning Model with Adaptive Balancing and Dual Cross-Validation: Retrospective Diagnostic Accuracy Study. Online Journal of Public Health Informatics, 18, e84966-e84966. https://doi.org/10.2196/84966

Vancouver

Minyilu Y, Yimer MA, Meshesha M. Automating Diagnosis of Skin Neglected Tropical Diseases via Patient Metadata through Machine Learning Model with Adaptive Balancing and Dual Cross-Validation: Retrospective Diagnostic Accuracy Study. Online Journal of Public Health Informatics. 2026;18:e84966-e84966. doi:10.2196/84966

BibTeX
@article{Minyilu2026,
  author = {Minyilu, Yohannes and Yimer, Mohammed Abebe and Meshesha, Million},
  title = {Automating Diagnosis of Skin Neglected Tropical Diseases via Patient Metadata through Machine Learning Model with Adaptive Balancing and Dual Cross-Validation: Retrospective Diagnostic Accuracy Study},
  journal = {Online Journal of Public Health Informatics},
  year = {2026},
  volume = {18},
  pages = {e84966--e84966},
  doi = {10.2196/84966}
}
Kostenlos starten →