EUVIMEDOpdag EUVIMED
Open access

Digital Epidemiology of Prescription Drug References on X (Formerly Twitter): Neural Network Topic Modeling and Sentiment Analysis

Varun K Rao iD, Danny Valdez iD, Rasika Muralidharan iD, Jon Agley iD, Kate S Eddens iD, Aravind Dendukuri iD, Vandana Panth iD, Maria A Parker iD

Journal of Medical Internet Research · 2024

DOI: 10.2196/57885 ↗

At a glance

Journal article in Journal of Medical Internet Research, 2024. Written by Varun K Rao and 7 co-authors. Institution: Department of Epidemiology & Biostatistics, School of Public Health Bloomington, Indiana University Bloomington, Bloomington, IN, United States. Major MEDLINE topics: Social Media, Neural Networks, Computer, Prescription Drugs. Cited 6 times so far (Crossref); 71 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Data from the social media platform X (formerly Twitter) can provide insights into the types of language that are used when discussing drug use. In past research using latent Dirichlet allocation (LDA), we found that tweets containing “street names” of prescription drugs were difficult to classify due to the similarity to other colloquialisms and lack of clarity over how the terms were used. Conversely, “brand name” references were more amenable to machine-driven categorization.

Objective

This study sought to use next-generation techniques (beyond LDA) from natural language processing to reprocess X data and automatically cluster groups of tweets into topics to differentiate between street- and brand-name data sets. We also aimed to analyze the differences in emotional valence between the 2 data sets to study the relationship between engagement on social media and sentiment.

Methods

We used the Twitter application programming interface to collect tweets that contained the street and brand name of a prescription drug within the tweet. Using BERTopic in combination with Uniform Manifold Approximation and Projection and k-means, we generated topics for the street-name corpus (n=170,618) and brand-name corpus (n=245,145). Valence Aware Dictionary and Sentiment Reasoner (VADER) scores were used to classify whether tweets within the topics had positive, negative, or neutral sentiments. Two different logistic regression classifiers were used to predict the sentiment label within each corpus. The first model used a tweet’s engagement metrics and topic ID to predict the label, while the second model used those features in addition to the top 5000 tweets with the largest term-frequency–inverse document frequency score.

Results

Using BERTopic, we identified 40 topics for the street-name data set and 5 topics for the brand-name data set, which we generalized into 8 and 5 topics of discussion, respectively. Four of the general themes of discussion in the brand-name corpus referenced drug use, while 2 themes of discussion in the street-name corpus referenced drug use. From the VADER scores, we found that both corpora were inclined toward positive sentiment. Adding the vectorized tweet text increased the accuracy of our models by around 40% compared with the models that did not incorporate the tweet text in both corpora.

Conclusions

BERTopic was able to classify tweets well. As with LDA, the discussion using brand names was more similar between tweets than the discussion using street names. VADER scores could only be logically applied to the brand-name corpus because of the high prevalence of non–drug-related topics in the street-name data. Brand-name tweets either discussed drugs positively or negatively, with few posts having a neutral emotionality. From our machine learning models, engagement alone was not enough to predict the sentiment label; the added context from the tweets was needed to understand the emotionality of a tweet.

Subjects

MeSH terms (MEDLINE)

Social MediaNeural Networks, ComputerPrescription DrugsHumansNatural Language Processing

Author keywords

BERTtopicNLPTwitterVADERValence Aware Dictionary and Sentiment Reasonerbrand namedigital epidemiologydrugdrug usedrugshealth informaticslatent Dirichlet allocationlogistic regressionmachine learningmachine-driven

Substances

Prescription Drugs

Authors and institutions

  • Department of Epidemiology & Biostatistics, School of Public Health Bloomington, Indiana University Bloomington, Bloomington, IN, United States.
  • Department of Applied Health Science, School of Public Health Bloomington, Indiana University Bloomington, Bloomington, IN, United States.
  • Luddy School of Informatics, Computing and Engineering, Indiana University Bloomington, Bloomington, IN, United States.

ORCID profiles: Varun K Rao, Danny Valdez, Rasika Muralidharan, Jon Agley, Kate S Eddens, Aravind Dendukuri, Vandana Panth, Maria A Parker

Cite

APA

Rao, V. K., Valdez, D., Muralidharan, R., Agley, J., Eddens, K. S., Dendukuri, A., Panth, V., & Parker, M. A. (2024). Digital Epidemiology of Prescription Drug References on X (Formerly Twitter): Neural Network Topic Modeling and Sentiment Analysis. Journal of Medical Internet Research. https://doi.org/10.2196/57885

Vancouver

Rao VK, Valdez D, Muralidharan R, Agley J, Eddens KS, Dendukuri A, et al. Digital Epidemiology of Prescription Drug References on X (Formerly Twitter): Neural Network Topic Modeling and Sentiment Analysis. Journal of Medical Internet Research. 2024. doi:10.2196/57885

BibTeX
@article{Rao2024,
  author = {Rao, Varun K and Valdez, Danny and Muralidharan, Rasika and Agley, Jon and Eddens, Kate S and Dendukuri, Aravind and Panth, Vandana and Parker, Maria A},
  title = {Digital Epidemiology of Prescription Drug References on X (Formerly Twitter): Neural Network Topic Modeling and Sentiment Analysis},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  doi = {10.2196/57885}
}
Start for free →