Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study
Journal of Medical Internet Research · 24.02.2025 · 27 · e62805
DOI: 10.2196/62805 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift Journal of Medical Internet Research, online erschienen am 24.02.2025. Verfasst von Soeun Kim und 16 weiteren Autor:innen. Beteiligte Einrichtung: Center for Digital Health, Medical Science Research Institute, Kyung Hee University Medical Center, Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Substance-Related Disorders, Machine Learning, Algorithms. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
To address gaps in global understanding of cultural and social variations, this study used a high-performance machine learning (ML) model to predict adolescent substance use across three national datasets.
Objective
This study aims to develop a generalizable predictive model for adolescent substance use using multinational datasets and ML.
Methods
The study used the Korea Youth Risk Behavior Web-Based Survey (KYRBS) from South Korea (n=1,098,641) to train ML models. For external validation, we used the Youth Risk Behavior Survey (YRBS) from the United States (n=2,511,916) and Norwegian nationwide Ungdata surveys (Ungdata) from Norway (n=700,660). After developing various ML models, we evaluated the final model’s performance using multiple metrics. We also assessed feature importance using traditional methods and further analyzed variable contributions through SHapley Additive exPlanation values.
Results
The study used nationwide adolescent datasets for ML model development and validation, analyzing data from 1,098,641 KYRBS adolescents, 2,511,916 YRBS participants, and 700,660 from Ungdata. The XGBoost model was the top performer on the KYRBS, achieving an area under receiver operating characteristic curve (AUROC) score of 80.61% (95% CI 79.63-81.59) and precision of 30.42 (95% CI 28.65-32.16) with detailed analysis on sensitivity of 31.30 (95% CI 29.47-33.20), specificity of 99.16 (95% CI 99.12-99.20), accuracy of 98.36 (95% CI 98.31-98.42), balanced accuracy of 65.23 (95% CI 64.31-66.17), F1-score of 30.85 (95% CI 29.25-32.51), and area under precision-recall curve of 32.14 (95% CI 30.34-33.95). The model achieved an AUROC score of 79.30% and a precision of 68.37% on the YRBS dataset, while in external validation using the Ungdata dataset, it recorded an AUROC score of 76.39% and a precision of 12.74%. Feature importance and SHapley Additive exPlanation value analyses identified smoking status, BMI, suicidal ideation, alcohol consumption, and feelings of sadness and despair as key contributors to the risk of substance use, with smoking status emerging as the most influential factor.
Conclusions
Based on multinational datasets from South Korea, the United States, and Norway, this study shows the potential of ML models, particularly the XGBoost model, in predicting adolescent substance use. These findings provide a solid basis for future research exploring additional influencing factors or developing targeted intervention strategies.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Center for Digital Health, Medical Science Research Institute, Kyung Hee University Medical Center, Seoul, Republic of Korea.
- Department of Precision Medicine, Kyung Hee University College of Medicine, Seoul, Republic of Korea.
- Department of Applied Information Engineering, Yonsei University, Seoul, Republic of Korea.
- Department of Medicine, Kyung Hee University College of Medicine, Seoul, Republic of Korea.
- Department of Business Administration, Kyung Hee University School of Management, Seoul, Republic of Korea.
- Department of Korean Medicine, Kyung Hee University College of Korean Medicine, Seoul, Republic of Korea.
ORCID-Profile: Soeun Kim, Hyejun Kim, Seokjun Kim, Hojae Lee, Ahmed Hammoodi, Yujin Choi, Hyeon Jin Kim, Lee Smith, Min Seo Kim, Guillaume Fond, Laurent Boyer, Sung Wook Baik, Hayeon Lee, Jaeyu Park, Rosie Kwon, Selin Woo, Dong Keon Yon
Zitieren
APA
Kim, S., Kim, H., Kim, S., Lee, H., Hammoodi, A., Choi, Y., Kim, H. J., Smith, L., Kim, M. S., Fond, G., Boyer, L., Baik, S. W., Lee, H., Park, J., Kwon, R., Woo, S., & Yon, D. K. (2025). Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study. Journal of Medical Internet Research, 27, e62805. https://doi.org/10.2196/62805
Vancouver
Kim S, Kim H, Kim S, Lee H, Hammoodi A, Choi Y, et al. Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study. Journal of Medical Internet Research. 2025;27:e62805. doi:10.2196/62805
BibTeX
@article{Kim2025,
author = {Kim, Soeun and Kim, Hyejun and Kim, Seokjun and Lee, Hojae and Hammoodi, Ahmed and Choi, Yujin and Kim, Hyeon Jin and Smith, Lee and Kim, Min Seo and Fond, Guillaume and Boyer, Laurent and Baik, Sung Wook and Lee, Hayeon and Park, Jaeyu and Kwon, Rosie and Woo, Selin and Yon, Dong Keon},
title = {Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e62805},
doi = {10.2196/62805}
}
EUVIMED