EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing

Michael Tonderai Mapundu iD, Chodziwadziwa Whiteson Kabudula, Eustasius Musenge, Victor Olago, Turgay Celik

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0308452 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Michael Tonderai Mapundu und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Epidemiology and Biostatistics, School of Public Health, University of the Witwatersrand, Johannesburg, South Africa. Hauptthemen laut MEDLINE: Data Mining, Natural Language Processing, Cause of Death, Autopsy. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Verbal autopsy (VA) narratives play a crucial role in understanding and documenting the causes of mortality, especially in regions lacking robust medical infrastructure. In this study, we propose a comprehensive approach to extract mortality causes and identify prevalent diseases from VA narratives utilizing advanced text mining techniques, so as to better understand the underlying health issues leading to mortality. Our methodology integrates n-gram-based language processing, Latent Dirichlet Allocation (LDA), and BERTopic, offering a multi-faceted analysis to enhance the accuracy and depth of information extraction. This is a retrospective study that uses secondary data analysis. We used data from the Agincourt Health and Demographic Surveillance Site (HDSS), which had 16338 observations collected between 1993 and 2015. Our text mining steps entailed data acquisition, pre-processing, feature extraction, topic segmentation, and discovered knowledge. The results suggest that the HDSS population may have died from mortality causes such as vomiting, chest/stomach pain, fever, coughing, loss of weight, low energy, headache . Additionally, we discovered that the most prevalent diseases entailed human immunodeficiency virus (HIV), tuberculosis (TB), diarrhoea, cancer, neurological disorders, malaria, diabetes, high blood pressure, chronic ailments (kidney, heart, lung, liver), maternal and accident related deaths. This study is relevant in that it avails valuable insights regarding mortality causes and most prevalent diseases using novel text mining approaches. These results can be integrated in the diagnosis pipeline for ease of human annotation and interpretation. As such, this will help with effective informed intervention programmes that can improve primary health care systems and chronic based delivery, thus increasing life expectancy.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data MiningNatural Language ProcessingCause of DeathAutopsyHumansRetrospective StudiesNarrationPrevalence

Autor:innen und Institutionen

  • Department of Epidemiology and Biostatistics, School of Public Health, University of the Witwatersrand, Johannesburg, South Africa.
  • MRC/Wits Rural Public Health and Health Transitions Research Unit (Agincourt), Johannesburg, South Africa.
  • National Health Laboratory Service (NHLS), National Cancer Registry, Johannesburg, South Africa.
  • Wits Institute of Data Science, University of The Witwatersrand, Johannesburg, South Africa.
  • School of Electrical and Information Engineering, University of The Witwatersrand, Johannesburg, South Africa.

ORCID-Profile: Michael Tonderai Mapundu

Zitieren

APA

Mapundu, M. T., Kabudula, C. W., Musenge, E., Olago, V., & Celik, T. (2024). Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing. PLOS ONE. https://doi.org/10.1371/journal.pone.0308452

Vancouver

Mapundu MT, Kabudula CW, Musenge E, Olago V, Celik T. Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing. PLOS ONE. 2024. doi:10.1371/journal.pone.0308452

BibTeX
@article{Mapundu2024,
  author = {Mapundu, Michael Tonderai and Kabudula, Chodziwadziwa Whiteson and Musenge, Eustasius and Olago, Victor and Celik, Turgay},
  title = {Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0308452}
}
Kostenlos starten →