EUVIMEDSkopri EUVIMED
ValidierungsstudieOpen access

Machine Learning–Based Prediction of Suicidal Thinking in Adolescents by Derivation and Validation in 3 Independent Worldwide Cohorts: Algorithm Development and Validation Study

Hyejun Kim iD, Yejun Son iD, Hojae Lee iD, Jiseung Kang iD, Ahmed Hammoodi iD, Yujin Choi iD, Hyeon Jin Kim iD, Hayeon Lee iD, Guillaume Fond iD, Laurent Boyer iD, Rosie Kwon iD, Selin Woo iD and 1 more

Journal of Medical Internet Research · 2024

DOI: 10.2196/55913 ↗

At a glance

Validierungsstudie in Journal of Medical Internet Research, 2024. Written by Hyejun Kim and 12 co-authors. Institution: Center for Digital Health, Medical Science Research Institute, Kyung Hee University College of Medicine, Seoul, Republic of Korea. Major MEDLINE topics: Machine Learning, Suicidal Ideation. Cited 33 times so far (Crossref); 49 references. The full text is freely available in PubMed Central.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Background

Suicide is the second-leading cause of death among adolescents and is associated with clusters of suicides. Despite numerous studies on this preventable cause of death, the focus has primarily been on single nations and traditional statistical methods.

Objective

This study aims to develop a predictive model for adolescent suicidal thinking using multinational data sets and machine learning (ML).

Methods

We used data from the Korea Youth Risk Behavior Web-based Survey with 566,875 adolescents aged between 13 and 18 years and conducted external validation using the Youth Risk Behavior Survey with 103,874 adolescents and Norway’s University National General Survey with 19,574 adolescents. Several tree-based ML models were developed, and feature importance and Shapley additive explanations values were analyzed to identify risk factors for adolescent suicidal thinking.

Results

When trained on the Korea Youth Risk Behavior Web-based Survey data from South Korea with a 95% CI, the XGBoost model reported an area under the receiver operating characteristic (AUROC) curve of 90.06% (95% CI 89.97-90.16), displaying superior performance compared to other models. For external validation using the Youth Risk Behavior Survey data from the United States and the University National General Survey from Norway, the XGBoost model achieved AUROCs of 83.09% and 81.27%, respectively. Across all data sets, XGBoost consistently outperformed the other models with the highest AUROC score, and was selected as the optimal model. In terms of predictors of suicidal thinking, feelings of sadness and despair were the most influential, accounting for 57.4% of the impact, followed by stress status at 19.8%. This was followed by age (5.7%), household income (4%), academic achievement (3.4%), sex (2.1%), and others, which contributed less than 2% each.

Conclusions

This study used ML by integrating diverse data sets from 3 countries to address adolescent suicide. The findings highlight the important role of emotional health indicators in predicting suicidal thinking among adolescents. Specifically, sadness and despair were identified as the most significant predictors, followed by stressful conditions and age. These findings emphasize the critical need for early diagnosis and prevention of mental health issues during adolescence.

Subjects

MeSH terms (MEDLINE)

Machine LearningSuicidal IdeationHumansAdolescentFemaleMaleRepublic of KoreaAlgorithmsCohort StudiesAdolescent BehaviorSuicideNorwaySurveys and QuestionnairesRisk FactorsRisk-Taking

Author keywords

SHAP valueShapley additive explanationsXGBoostadolescentmachine learningmental healthpredictive modelrisk behaviorsuicidal thinking

Authors and institutions

  • Center for Digital Health, Medical Science Research Institute, Kyung Hee University College of Medicine, Seoul, Republic of Korea.
  • Department of Applied Information Engineering, Yonsei University, Seoul, Republic of Korea.
  • Department of Precision Medicine, Kyung Hee University College of Medicine, Seoul, Republic of Korea.
  • Department of Regulatory Science, Kyung Hee University, Seoul, Republic of Korea.
  • Division of Sleep Medicine, Harvard Medical School, Boston, MA, United States.
  • Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, United States.

ORCID profiles: Hyejun Kim, Yejun Son, Hojae Lee, Jiseung Kang, Ahmed Hammoodi, Yujin Choi, Hyeon Jin Kim, Hayeon Lee, Guillaume Fond, Laurent Boyer, Rosie Kwon, Selin Woo, Dong Keon Yon

Cite

APA

Kim, H., Son, Y., Lee, H., Kang, J., Hammoodi, A., Choi, Y., Kim, H. J., Lee, H., Fond, G., Boyer, L., Kwon, R., Woo, S., & Yon, D. K. (2024). Machine Learning–Based Prediction of Suicidal Thinking in Adolescents by Derivation and Validation in 3 Independent Worldwide Cohorts: Algorithm Development and Validation Study. Journal of Medical Internet Research. https://doi.org/10.2196/55913

Vancouver

Kim H, Son Y, Lee H, Kang J, Hammoodi A, Choi Y, et al. Machine Learning–Based Prediction of Suicidal Thinking in Adolescents by Derivation and Validation in 3 Independent Worldwide Cohorts: Algorithm Development and Validation Study. Journal of Medical Internet Research. 2024. doi:10.2196/55913

BibTeX
@article{Kim2024,
  author = {Kim, Hyejun and Son, Yejun and Lee, Hojae and Kang, Jiseung and Hammoodi, Ahmed and Choi, Yujin and Kim, Hyeon Jin and Lee, Hayeon and Fond, Guillaume and Boyer, Laurent and Kwon, Rosie and Woo, Selin and Yon, Dong Keon},
  title = {Machine Learning–Based Prediction of Suicidal Thinking in Adolescents by Derivation and Validation in 3 Independent Worldwide Cohorts: Algorithm Development and Validation Study},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  doi = {10.2196/55913}
}
Start for free →