EUVIMEDEUVIMED entdecken
Open Access

Sentiment Analysis Using a Large Language Model–Based Approach to Detect Opioids Mixed With Other Substances Via Social Media: Method Development and Validation

Muhammad Ahmad iD, Ildar Batyrshin iD, Grigori Sidorov iD

JMIR Infodemiology · 19.06.2025 · 5 · e70525-e70525

DOI: 10.2196/70525 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Infodemiology, online erschienen am 19.06.2025. Verfasst von Muhammad Ahmad und 2 weiteren Autor:innen. Beteiligte Einrichtung: Centro de Investigación en Computación, Instituto Politécnico Nacional, Mexico City, 07738, Mexico, 52 5591887293. Hauptthemen laut MEDLINE: Social Media, Analgesics, Opioid, Opioid-Related Disorders. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The opioid crisis poses a significant health challenge in the United States, with increasing overdoses and death rates due to opioids mixed with other illicit substances. Various strategies have been developed by federal and local governments and health organizations to address this crisis. One of the most significant objectives is to understand the epidemic through better health surveillance, and machine learning techniques can support this by identifying opioid users at risk of overdose through the analysis of social media data, as many individuals may avoid direct testing but still share their experiences online.

Objective

In this study, we take advantage of recent developments in machine learning that allow for insights into patterns of opioid use and potential risk factors in a less invasive manner using self-reported information available on social platforms.

Methods

This study used YouTube comments posted between December 2020 and March 2024, in which individuals shared their self-reported experiences of opioid drugs mixed with other substances. We manually annotated our dataset into multiclass categories, capturing both the positive effects of opioid use, such as pain relief, euphoria, and relaxation, and negative experiences, including nausea, sadness, and respiratory depression, to provide a comprehensive understanding of the multifaceted impact of opioids. By analyzing this sentiment, we used 4 state-of-the-art machine learning models, 2 deep learning models, 3 transformer models, and 1 large language model (GPT-3.5 Turbo) to predict overdose risks to improve health care response and intervention strategies.

Results

Our proposed methodology (GPT-3.5 Turbo) was highly precise and accurate, helping to automatically identify sentiment based on the adverse effects of opioid drug combinations and high-risk drug use in YouTube comments. Our proposed methodology demonstrated the highest achievable F 1 -score of 0.95 and a 3.26% performance improvement over traditional machine learning models such as extreme gradient boosting, which demonstrated an F 1 -score of 0.92.

Conclusions

This study demonstrates the potential of leveraging machine learning and large language models, such as GPT-3.5 Turbo, to analyze public sentiment surrounding opioid use and its associated risks. By using YouTube comments as a rich source of self-reported data, the study provides valuable insights into both the positive and negative effects of opioids, particularly when mixed with other substances. The proposed methodology significantly outperformed traditional models, contributing to more accurate predictions of overdose risks and enhancing health care responses to the opioid crisis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Social MediaAnalgesics, OpioidOpioid-Related DisordersHumansMachine LearningUnited StatesDrug OverdoseLarge Language Models

Stichwörter der Autor:innen

BERTChatGPTNLPRedditbidirectional encoder representations from transformerschronic paindata miningdeep learninghigh doselarge language modelsnatural language processingopioid overdosesocial mediasuicide

Substanzen

Analgesics, Opioid

Autor:innen und Institutionen

  • Centro de Investigación en Computación, Instituto Politécnico Nacional, Mexico City, 07738, Mexico, 52 5591887293.

ORCID-Profile: Muhammad Ahmad, Ildar Batyrshin, Grigori Sidorov

Zitieren

APA

Ahmad, M., Batyrshin, I., & Sidorov, G. (2025). Sentiment Analysis Using a Large Language Model–Based Approach to Detect Opioids Mixed With Other Substances Via Social Media: Method Development and Validation. JMIR Infodemiology, 5, e70525-e70525. https://doi.org/10.2196/70525

Vancouver

Ahmad M, Batyrshin I, Sidorov G. Sentiment Analysis Using a Large Language Model–Based Approach to Detect Opioids Mixed With Other Substances Via Social Media: Method Development and Validation. JMIR Infodemiology. 2025;5:e70525-e70525. doi:10.2196/70525

BibTeX
@article{Ahmad2025,
  author = {Ahmad, Muhammad and Batyrshin, Ildar and Sidorov, Grigori},
  title = {Sentiment Analysis Using a Large Language Model–Based Approach to Detect Opioids Mixed With Other Substances Via Social Media: Method Development and Validation},
  journal = {JMIR Infodemiology},
  year = {2025},
  volume = {5},
  pages = {e70525--e70525},
  doi = {10.2196/70525}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche