EUVIMEDObjevte EUVIMED
ValidierungsstudieOpen access

Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study

Sarvech Qadir iD, Ashwaq Alsoubai iD, Jinkyung Katie Park iD, Naima Samreen Ali iD, Munmun De Choudhury iD, Pamela Wisniewski iD

JMIR Mental Health · 2026-01-23 · 13 · e76051

DOI: 10.2196/76051 ↗

At a glance

Validierungsstudie in JMIR Mental Health, published online on 2026-01-23. Written by Sarvech Qadir and 5 co-authors. Institution: Department of Computer Science, Vanderbilt University, Nashville, TN, United States. Major MEDLINE topics: Self-Injurious Behavior, Machine Learning, Social Media, Suicide. Cited 5 times so far (Crossref); 93 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

This study aims to detect self-harm or suicide (SH-S) ideation language used by youth (aged 13-21 y) in their private Instagram (Meta) conversations. While automated mental health tools have shown promise, there remains a gap in understanding how nuanced youth language around SH-S can be effectively identified.

Objective

Our work aimed to develop interpretable models that go beyond binary classification to recognize the spectrum of SH-S expressions.

Methods

We analyzed a dataset of Instagram private conversations donated by youth. A range of traditional machine learning models (support vector machine, random forest, Naive Bayes, and extreme gradient boosting) and transformer-based architectures (Bidirectional Encoder Representations from Transformers and Distilled Bidirectional Encoder Representations from Transformers) were trained and evaluated. In addition to raw text, we incorporated contextual, psycholinguistic (linguistic injury word count), sentiment (Valence Aware Dictionary and Sentiment Reasoner), and lexical (term frequency–inverse document frequency) features to improve detection accuracy. We further explored how increasing conversational context—from message-level to subconversation level—affected model performance.

Results

Distilled Bidirectional Encoder Representations from Transformers demonstrated a good performance in identifying the presence of SH-S behaviors within individual messages, achieving an accuracy of 99%. However, when tasked with a more fine-grained classification—differentiating among “self” (personal accounts of SH-S), “other” (references to SH-S experiences involving others), and “hyperbole” (sarcastic, humorous, or exaggerated mentions not indicative of genuine risk)—the model’s accuracy declined to 89%. Notably, by expanding the input window to include a broader conversational context, the model’s performance on these granular categories improved to 91%, highlighting the importance of contextual understanding when distinguishing between subtle variations in SH-S discourse.

Conclusions

Our findings underscore the importance of designing SH-S automatic detection systems sensitive to the dynamic language of youth and social media. Contextual and sentiment-aware models improve detection and provide a nuanced understanding of SH-S risk expression. This research lays the foundation for developing inclusive and ethically grounded interventions, while also calling for future work to validate these models across platforms and populations.

Subjects

MeSH terms (MEDLINE)

Self-Injurious BehaviorMachine LearningSocial MediaSuicideHumansAdolescentYoung AdultFemaleAlgorithmsMaleClassification AlgorithmsPredictive Learning Models

Author keywords

machine learningmental healthnatural language processingsuicide/self-harmyouth

Authors and institutions

  • Department of Computer Science, Vanderbilt University, Nashville, TN, United States.
  • Department of Information Systems, King Abdulaziz University, Jeddah, Saudi Arabia.
  • School of Computing, Clemson University, Clemson, SC, United States.
  • School of Information, University of Michigan, Ann Arbor, MI, United States.
  • School of Interactive Computing, Georgia Institute of Technology, Atlanta, GA, United States.
  • International Computer Science Institute, ICSI, Berkeley, CA, United States.

ORCID profiles: Sarvech Qadir, Ashwaq Alsoubai, Jinkyung Katie Park, Naima Samreen Ali, Munmun De Choudhury, Pamela Wisniewski

Cite

APA

Qadir, S., Alsoubai, A., Park, J. K., Ali, N. S., Choudhury, M., & Wisniewski, P. (2026). Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study. JMIR Mental Health, 13, e76051. https://doi.org/10.2196/76051

Vancouver

Qadir S, Alsoubai A, Park JK, Ali NS, Choudhury M, Wisniewski P. Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study. JMIR Mental Health. 2026;13:e76051. doi:10.2196/76051

BibTeX
@article{Qadir2026,
  author = {Qadir, Sarvech and Alsoubai, Ashwaq and Park, Jinkyung Katie and Ali, Naima Samreen and Choudhury, Munmun De and Wisniewski, Pamela},
  title = {Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study},
  journal = {JMIR Mental Health},
  year = {2026},
  volume = {13},
  pages = {e76051},
  doi = {10.2196/76051}
}
Start for free →