Combining Topic Modeling, Sentiment Analysis, and Corpus Linguistics to Analyze Unstructured Web-Based Patient Experience Data: Case Study of Modafinil Experiences
Journal of Medical Internet Research · 11.12.2024 · 26 · e54321
DOI: 10.2196/54321 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 11.12.2024. Verfasst von Julia Walsh und 2 weiteren Autor:innen. Beteiligte Einrichtung: Warwick Medical School, University of Warwick, Coventry, United Kingdom. Hauptthemen laut MEDLINE: Modafinil, Natural Language Processing, Linguistics. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 101 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Patient experience data from social media offer patient-centered perspectives on disease, treatments, and health service delivery. Current guidelines typically rely on systematic reviews, while qualitative health studies are often seen as anecdotal and nongeneralizable. This study explores combining personal health experiences from multiple sources to create generalizable evidence.
Objective
The study aims to (1) investigate how combining unsupervised natural language processing (NLP) and corpus linguistics can explore patient perspectives from a large unstructured dataset of modafinil experiences, (2) compare findings with Cochrane meta-analyses on modafinil’s effectiveness, and (3) develop a methodology for analyzing such data.
Methods
Using 69,022 posts from 790 sources, we used a variety of NLP and corpus techniques to analyze the data, including data cleaning techniques to maximize post context, Python for NLP techniques, and Sketch Engine for linguistic analysis. We used multiple topic mining approaches, such as latent Dirichlet allocation, nonnegative matrix factorization, and word-embedding methods. Sentiment analysis used TextBlob and Valence Aware Dictionary and Sentiment Reasoner, while corpus methods including collocation, concordance, and n-gram generation. Previous work had mapped topic mining to themes, such as health conditions, reasons for taking modafinil, symptom impacts, dosage, side effects, effectiveness, and treatment comparisons.
Results
Key findings of the study included modafinil use across 166 health conditions, most frequently narcolepsy, multiple sclerosis, attention-deficit disorder, anxiety, sleep apnea, depression, bipolar disorder, chronic fatigue syndrome, fibromyalgia, and chronic disease. Word-embedding topic modeling mapped 70% of posts to predefined themes, while sentiment analysis revealed 65% positive responses, 6% neutral responses, and 28% negative responses. Notably, the perceived effectiveness of modafinil for various conditions strongly contrasts with the findings of existing randomized controlled trials and systematic reviews, which conclude insufficient or low-quality evidence of effectiveness.
Conclusions
This study demonstrated the value of combining NLP with linguistic techniques for analyzing large unstructured text datasets. Despite varying opinions, findings were methodologically consistent and challenged existing clinical evidence. This suggests that patient-generated data could potentially provide valuable insights into treatment outcomes, potentially improving clinical understanding and patient care.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Warwick Medical School, University of Warwick, Coventry, United Kingdom.
- Department of Economics, University of Warwick, Coventry, United Kingdom.
- Centre for Health Policy, University of the Witwatersrand, Johannesburg, South Africa.
ORCID-Profile: Julia Walsh, Jonathan Cave, Frances Griffiths
Zitieren
APA
Walsh, J., Cave, J., & Griffiths, F. (2024). Combining Topic Modeling, Sentiment Analysis, and Corpus Linguistics to Analyze Unstructured Web-Based Patient Experience Data: Case Study of Modafinil Experiences. Journal of Medical Internet Research, 26, e54321. https://doi.org/10.2196/54321
Vancouver
Walsh J, Cave J, Griffiths F. Combining Topic Modeling, Sentiment Analysis, and Corpus Linguistics to Analyze Unstructured Web-Based Patient Experience Data: Case Study of Modafinil Experiences. Journal of Medical Internet Research. 2024;26:e54321. doi:10.2196/54321
BibTeX
@article{Walsh2024,
author = {Walsh, Julia and Cave, Jonathan and Griffiths, Frances},
title = {Combining Topic Modeling, Sentiment Analysis, and Corpus Linguistics to Analyze Unstructured Web-Based Patient Experience Data: Case Study of Modafinil Experiences},
journal = {Journal of Medical Internet Research},
year = {2024},
volume = {26},
pages = {e54321},
doi = {10.2196/54321}
}
EUVIMED