EUVIMEDEUVIMED entdecken
Open Access

Extracting Symptoms of Complex Conditions From Online Discourse (Subreddit to Symptomatology): Lexicon-Based Approach

Bushra Hossain iD, Sarah M Preum iD, Md Fazle Rabbi iD, Rifat Ara iD, Mohammed Eunus Ali iD

JMIR Medical Informatics · 12.09.2025 · 13 · e70940

DOI: 10.2196/70940 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Medical Informatics, online erschienen am 12.09.2025. Verfasst von Bushra Hossain und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh. Hauptthemen laut MEDLINE: Natural Language Processing, Social Media, Data Mining. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 71 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIDA NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Millions of people affected with complex medical conditions with diverse symptoms often turn to online discourse to share their experiences. While some studies have explored natural language processing methods and medical information extraction tools, these typically focus on generic symptoms in clinical notes and struggle to identify patient-reported, disease-specific, subtle symptoms from online health discourse.

Objective

We aimed to extract patient-reported, disease-specific symptoms shared on social media reflecting the lived experiences of thousands of affected individuals and explore the characteristics, prevalence, and occurrence patterns of the symptoms.

Methods

We propose a lexicon-based symptom extraction (LSE) method to identify a diverse list of disease-specific, patient-reported symptoms. We initially used a large language model to accelerate the extraction of symptom-related key phrases that formed the lexicon. We evaluated the effectiveness of lexicon extraction against human annotation using a Jaccard index score. We then leveraged BERT-Base, BioBERT, and Phrase-BERT–based embeddings to learn representations of these symptom-related key phrases and cluster similar symptoms using k-means and hierarchical density-based spatial clustering of applications with noise (HDBSCAN). Among the different options explored in our experiments, BioBERT-based k-means clustering was found to be the most effective. Finally, we applied symptom normalization to eliminate duplicate and redundant entries in the comprehensive symptom list.

Results

In a real-world polycystic ovary syndrome (PCOS) subreddit dataset, we found that LSE significantly outperformed state-of-the-art baselines, achieving at least 41% and 20% higher F1-scores (mean 86.10) than automatic medical extraction tools and large language models, respectively. Notably, the comprehensive list of 64 PCOS symptoms generated via LSE ensured extensive coverage of symptoms reported in 7 reputable eHealth forums. Analyzing PCOS symptomatology revealed 28 potentially emerging symptoms and 8 self-reported comorbidities co-occurring with PCOS.

Conclusions

The comprehensive patient-reported, disease-specific symptom list can help patients and health practitioners resolve uncertainties surrounding the disease, eliminating the variability of PCOS symptoms prevailing in the community. Analyzing PCOS symptomatology across varied dimensions provides valuable insights for public health research.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingSocial MediaData MiningHumansFemale

Stichwörter der Autor:innen

complex medical conditiondisease-specific symptomshealth information extractionlarge language modelsnatural language processingonline discoursepolycystic ovary syndromesymptomatology

Autor:innen und Institutionen

  • Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh.
  • Department of Computer Science, Dartmouth College, Hanover, NH, United States.
  • Department of Biomedical Data Science, Geisel School of Medicine, Hanover, NH, United States.
  • Department of Computer Science and Engineering, Bangladesh University of Professionals, Dhaka, Bangladesh.
  • Department of Obstetrics & Gynecology, Bangladesh College of Physicians and Surgeons, Dhaka, Bangladesh.
  • Faculty of Information Technology, Monash University, Clayton, Australia.

ORCID-Profile: Bushra Hossain, Sarah M Preum, Md Fazle Rabbi, Rifat Ara, Mohammed Eunus Ali

Förderung

  • NIDA NIH HHS

Zitieren

APA

Hossain, B., Preum, S. M., Rabbi, M. F., Ara, R., & Ali, M. E. (2025). Extracting Symptoms of Complex Conditions From Online Discourse (Subreddit to Symptomatology): Lexicon-Based Approach. JMIR Medical Informatics, 13, e70940. https://doi.org/10.2196/70940

Vancouver

Hossain B, Preum SM, Rabbi MF, Ara R, Ali ME. Extracting Symptoms of Complex Conditions From Online Discourse (Subreddit to Symptomatology): Lexicon-Based Approach. JMIR Medical Informatics. 2025;13:e70940. doi:10.2196/70940

BibTeX
@article{Hossain2025,
  author = {Hossain, Bushra and Preum, Sarah M and Rabbi, Md Fazle and Ara, Rifat and Ali, Mohammed Eunus},
  title = {Extracting Symptoms of Complex Conditions From Online Discourse (Subreddit to Symptomatology): Lexicon-Based Approach},
  journal = {JMIR Medical Informatics},
  year = {2025},
  volume = {13},
  pages = {e70940},
  doi = {10.2196/70940}
}
Kostenlos starten →