Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study
JMIR Mental Health · 23.01.2026 · 13 · e76051
DOI: 10.2196/76051 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift JMIR Mental Health, online erschienen am 23.01.2026. Verfasst von Sarvech Qadir und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Vanderbilt University, Nashville, TN, United States. Hauptthemen laut MEDLINE: Self-Injurious Behavior, Machine Learning, Social Media, Suicide. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 93 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
This study aims to detect self-harm or suicide (SH-S) ideation language used by youth (aged 13-21 y) in their private Instagram (Meta) conversations. While automated mental health tools have shown promise, there remains a gap in understanding how nuanced youth language around SH-S can be effectively identified.
Objective
Our work aimed to develop interpretable models that go beyond binary classification to recognize the spectrum of SH-S expressions.
Methods
We analyzed a dataset of Instagram private conversations donated by youth. A range of traditional machine learning models (support vector machine, random forest, Naive Bayes, and extreme gradient boosting) and transformer-based architectures (Bidirectional Encoder Representations from Transformers and Distilled Bidirectional Encoder Representations from Transformers) were trained and evaluated. In addition to raw text, we incorporated contextual, psycholinguistic (linguistic injury word count), sentiment (Valence Aware Dictionary and Sentiment Reasoner), and lexical (term frequency–inverse document frequency) features to improve detection accuracy. We further explored how increasing conversational context—from message-level to subconversation level—affected model performance.
Results
Distilled Bidirectional Encoder Representations from Transformers demonstrated a good performance in identifying the presence of SH-S behaviors within individual messages, achieving an accuracy of 99%. However, when tasked with a more fine-grained classification—differentiating among “self” (personal accounts of SH-S), “other” (references to SH-S experiences involving others), and “hyperbole” (sarcastic, humorous, or exaggerated mentions not indicative of genuine risk)—the model’s accuracy declined to 89%. Notably, by expanding the input window to include a broader conversational context, the model’s performance on these granular categories improved to 91%, highlighting the importance of contextual understanding when distinguishing between subtle variations in SH-S discourse.
Conclusions
Our findings underscore the importance of designing SH-S automatic detection systems sensitive to the dynamic language of youth and social media. Contextual and sentiment-aware models improve detection and provide a nuanced understanding of SH-S risk expression. This research lays the foundation for developing inclusive and ethically grounded interventions, while also calling for future work to validate these models across platforms and populations.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, Vanderbilt University, Nashville, TN, United States.
- Department of Information Systems, King Abdulaziz University, Jeddah, Saudi Arabia.
- School of Computing, Clemson University, Clemson, SC, United States.
- School of Information, University of Michigan, Ann Arbor, MI, United States.
- School of Interactive Computing, Georgia Institute of Technology, Atlanta, GA, United States.
- International Computer Science Institute, ICSI, Berkeley, CA, United States.
ORCID-Profile: Sarvech Qadir, Ashwaq Alsoubai, Jinkyung Katie Park, Naima Samreen Ali, Munmun De Choudhury, Pamela Wisniewski
Zitieren
APA
Qadir, S., Alsoubai, A., Park, J. K., Ali, N. S., Choudhury, M., & Wisniewski, P. (2026). Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study. JMIR Mental Health, 13, e76051. https://doi.org/10.2196/76051
Vancouver
Qadir S, Alsoubai A, Park JK, Ali NS, Choudhury M, Wisniewski P. Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study. JMIR Mental Health. 2026;13:e76051. doi:10.2196/76051
BibTeX
@article{Qadir2026,
author = {Qadir, Sarvech and Alsoubai, Ashwaq and Park, Jinkyung Katie and Ali, Naima Samreen and Choudhury, Munmun De and Wisniewski, Pamela},
title = {Triaging Casual From Critical—Leveraging Machine Learning to Detect Self-Harm and Suicide Risks for Youth on Social Media: Algorithm Development and Validation Study},
journal = {JMIR Mental Health},
year = {2026},
volume = {13},
pages = {e76051},
doi = {10.2196/76051}
}
EUVIMED