EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study

Soeun Kim iD, Hyejun Kim iD, Seokjun Kim iD, Hojae Lee iD, Ahmed Hammoodi iD, Yujin Choi iD, Hyeon Jin Kim iD, Lee Smith iD, Min Seo Kim iD, Guillaume Fond iD, Laurent Boyer iD, Sung Wook Baik iD und 5 weitere

Journal of Medical Internet Research · 24.02.2025 · 27 · e62805

DOI: 10.2196/62805 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Journal of Medical Internet Research, online erschienen am 24.02.2025. Verfasst von Soeun Kim und 16 weiteren Autor:innen. Beteiligte Einrichtung: Center for Digital Health, Medical Science Research Institute, Kyung Hee University Medical Center, Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Substance-Related Disorders, Machine Learning, Algorithms. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

To address gaps in global understanding of cultural and social variations, this study used a high-performance machine learning (ML) model to predict adolescent substance use across three national datasets.

Objective

This study aims to develop a generalizable predictive model for adolescent substance use using multinational datasets and ML.

Methods

The study used the Korea Youth Risk Behavior Web-Based Survey (KYRBS) from South Korea (n=1,098,641) to train ML models. For external validation, we used the Youth Risk Behavior Survey (YRBS) from the United States (n=2,511,916) and Norwegian nationwide Ungdata surveys (Ungdata) from Norway (n=700,660). After developing various ML models, we evaluated the final model’s performance using multiple metrics. We also assessed feature importance using traditional methods and further analyzed variable contributions through SHapley Additive exPlanation values.

Results

The study used nationwide adolescent datasets for ML model development and validation, analyzing data from 1,098,641 KYRBS adolescents, 2,511,916 YRBS participants, and 700,660 from Ungdata. The XGBoost model was the top performer on the KYRBS, achieving an area under receiver operating characteristic curve (AUROC) score of 80.61% (95% CI 79.63-81.59) and precision of 30.42 (95% CI 28.65-32.16) with detailed analysis on sensitivity of 31.30 (95% CI 29.47-33.20), specificity of 99.16 (95% CI 99.12-99.20), accuracy of 98.36 (95% CI 98.31-98.42), balanced accuracy of 65.23 (95% CI 64.31-66.17), F1-score of 30.85 (95% CI 29.25-32.51), and area under precision-recall curve of 32.14 (95% CI 30.34-33.95). The model achieved an AUROC score of 79.30% and a precision of 68.37% on the YRBS dataset, while in external validation using the Ungdata dataset, it recorded an AUROC score of 76.39% and a precision of 12.74%. Feature importance and SHapley Additive exPlanation value analyses identified smoking status, BMI, suicidal ideation, alcohol consumption, and feelings of sadness and despair as key contributors to the risk of substance use, with smoking status emerging as the most influential factor.

Conclusions

Based on multinational datasets from South Korea, the United States, and Norway, this study shows the potential of ML models, particularly the XGBoost model, in predicting adolescent substance use. These findings provide a solid basis for future research exploring additional influencing factors or developing targeted intervention strategies.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Substance-Related DisordersMachine LearningAlgorithmsHumansAdolescentRepublic of KoreaFemaleMaleNorwayCohort StudiesUnited StatesAdolescent BehaviorSurveys and Questionnaires

Stichwörter der Autor:innen

MLNorwaySouth KoreaUnited StatesXGBoostadolescentadolescentsalcoholinterventioninterventionsmachine learningpredictionrandom forestrisk behaviorsmoking

Autor:innen und Institutionen

  • Center for Digital Health, Medical Science Research Institute, Kyung Hee University Medical Center, Seoul, Republic of Korea.
  • Department of Precision Medicine, Kyung Hee University College of Medicine, Seoul, Republic of Korea.
  • Department of Applied Information Engineering, Yonsei University, Seoul, Republic of Korea.
  • Department of Medicine, Kyung Hee University College of Medicine, Seoul, Republic of Korea.
  • Department of Business Administration, Kyung Hee University School of Management, Seoul, Republic of Korea.
  • Department of Korean Medicine, Kyung Hee University College of Korean Medicine, Seoul, Republic of Korea.

ORCID-Profile: Soeun Kim, Hyejun Kim, Seokjun Kim, Hojae Lee, Ahmed Hammoodi, Yujin Choi, Hyeon Jin Kim, Lee Smith, Min Seo Kim, Guillaume Fond, Laurent Boyer, Sung Wook Baik, Hayeon Lee, Jaeyu Park, Rosie Kwon, Selin Woo, Dong Keon Yon

Zitieren

APA

Kim, S., Kim, H., Kim, S., Lee, H., Hammoodi, A., Choi, Y., Kim, H. J., Smith, L., Kim, M. S., Fond, G., Boyer, L., Baik, S. W., Lee, H., Park, J., Kwon, R., Woo, S., & Yon, D. K. (2025). Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study. Journal of Medical Internet Research, 27, e62805. https://doi.org/10.2196/62805

Vancouver

Kim S, Kim H, Kim S, Lee H, Hammoodi A, Choi Y, et al. Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study. Journal of Medical Internet Research. 2025;27:e62805. doi:10.2196/62805

BibTeX
@article{Kim2025,
  author = {Kim, Soeun and Kim, Hyejun and Kim, Seokjun and Lee, Hojae and Hammoodi, Ahmed and Choi, Yujin and Kim, Hyeon Jin and Smith, Lee and Kim, Min Seo and Fond, Guillaume and Boyer, Laurent and Baik, Sung Wook and Lee, Hayeon and Park, Jaeyu and Kwon, Rosie and Woo, Selin and Yon, Dong Keon},
  title = {Machine Learning–Based Prediction of Substance Use in Adolescents in Three Independent Worldwide Cohorts: Algorithm Development and Validation Study},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  volume = {27},
  pages = {e62805},
  doi = {10.2196/62805}
}
Kostenlos starten →