EUVIMEDScopri EUVIMED
Crossref

Analyzing Online Discourse of Retrograde Cricopharyngeal Dysfunction: A Human‐Validated LLM Study

Spencer T Johnson iD, Nancy Jiang

Otolaryngology–Head and Neck Surgery · 2026-10-29

DOI: 10.1002/ohn.70506 ↗

At a glance

Journal article in Otolaryngology–Head and Neck Surgery, published online on 2026-10-29. Written by Spencer T Johnson and 1 co-authors. Institution: Department of Otolaryngology-Head and Neck Surgery, Stanford University, Palo Alto, California, USA. 26 references.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Objectives

Perform a human‐validated large language model (LLM) analysis of an online Reddit community dedicated to retrograde cricopharyngeal dysfunction (R‐CPD), characterizing common themes, symptoms, treatment experiences, and diagnostic barriers. Study Design Cross‐sectional, observational analysis of patient‐generated online discourse using LLM‐based thematic classification validated against human adjudication. Setting r/NoBurp, a public Reddit community dedicated to R‐CPD.

Methods

All posts from March 2014 to December 2025 were extracted and deduplicated. A 400‐post subset was human‐adjudicated to establish a reference standard for interrater comparison (precision, recall, F1 score, Cohen's kappa). All posts were analyzed with ChatGPT‐5.2 for theme identification, temporal trends, symptoms frequency, and sentiment analysis. A bibliometric analysis compared annual R‐CPD publication volume to annual Reddit post volume.

Results

20,299 unique posts were analyzed. The five dominant themes were core symptom burden (56.5%), treatment experience (53.3%), healthcare navigation (26.0%), self‐management (15.2%), and reflux‐related symptoms (12.5%). Annual post volume rose sharply years before the major increase in R‐CPD‐related publications. Interrater agreement was high for botulinum toxin/procedural treatment ( k = 0.70, 95% CI [0.64‐0.77], F1 = 0.81), moderate for core symptom burden ( k = 0.44, 95% CI [0.36‐0.52], F1 = 0.77), and slight‐to‐fair for diagnostic journey/healthcare navigation ( k = 0.22, 95% CI [0.15‐0.29], F1 = 0.38).

Conclusion

Patients experience prolonged diagnostic journeys marked by clinician unfamiliarity with R‐CPD, often identifying their condition through online communities. Rising patient discourse preceded growth in the published literature, suggesting that r/NoBurp functioned not only as a support forum but also as an accelerator of R‐CPD research.

Subjects

Author keywords

large language modelspatient‐reported experience measuresretrograde cricopharyngeal dysfunctionsocial media analysis

Authors and institutions

  • Department of Otolaryngology-Head and Neck Surgery, Stanford University, Palo Alto, California, USA.
  • Icahn School of Medicine at Mount Sinai, New York City, New York, USA.

ORCID profiles: Spencer T Johnson

Cite

APA

Johnson, S. T., & Jiang, N. (2026). Analyzing Online Discourse of Retrograde Cricopharyngeal Dysfunction: A Human‐Validated LLM Study. Otolaryngology–Head and Neck Surgery. https://doi.org/10.1002/ohn.70506

Vancouver

Johnson ST, Jiang N. Analyzing Online Discourse of Retrograde Cricopharyngeal Dysfunction: A Human‐Validated LLM Study. Otolaryngology–Head and Neck Surgery. 2026. doi:10.1002/ohn.70506

BibTeX
@article{Johnson2026,
  author = {Johnson, Spencer T and Jiang, Nancy},
  title = {Analyzing Online Discourse of Retrograde Cricopharyngeal Dysfunction: A Human‐Validated LLM Study},
  journal = {Otolaryngology–Head and Neck Surgery},
  year = {2026},
  doi = {10.1002/ohn.70506}
}
Start for free →