Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0308452 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Michael Tonderai Mapundu und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Epidemiology and Biostatistics, School of Public Health, University of the Witwatersrand, Johannesburg, South Africa. Hauptthemen laut MEDLINE: Data Mining, Natural Language Processing, Cause of Death, Autopsy. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Verbal autopsy (VA) narratives play a crucial role in understanding and documenting the causes of mortality, especially in regions lacking robust medical infrastructure. In this study, we propose a comprehensive approach to extract mortality causes and identify prevalent diseases from VA narratives utilizing advanced text mining techniques, so as to better understand the underlying health issues leading to mortality. Our methodology integrates n-gram-based language processing, Latent Dirichlet Allocation (LDA), and BERTopic, offering a multi-faceted analysis to enhance the accuracy and depth of information extraction. This is a retrospective study that uses secondary data analysis. We used data from the Agincourt Health and Demographic Surveillance Site (HDSS), which had 16338 observations collected between 1993 and 2015. Our text mining steps entailed data acquisition, pre-processing, feature extraction, topic segmentation, and discovered knowledge. The results suggest that the HDSS population may have died from mortality causes such as vomiting, chest/stomach pain, fever, coughing, loss of weight, low energy, headache . Additionally, we discovered that the most prevalent diseases entailed human immunodeficiency virus (HIV), tuberculosis (TB), diarrhoea, cancer, neurological disorders, malaria, diabetes, high blood pressure, chronic ailments (kidney, heart, lung, liver), maternal and accident related deaths. This study is relevant in that it avails valuable insights regarding mortality causes and most prevalent diseases using novel text mining approaches. These results can be integrated in the diagnosis pipeline for ease of human annotation and interpretation. As such, this will help with effective informed intervention programmes that can improve primary health care systems and chronic based delivery, thus increasing life expectancy.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Epidemiology and Biostatistics, School of Public Health, University of the Witwatersrand, Johannesburg, South Africa.
- MRC/Wits Rural Public Health and Health Transitions Research Unit (Agincourt), Johannesburg, South Africa.
- National Health Laboratory Service (NHLS), National Cancer Registry, Johannesburg, South Africa.
- Wits Institute of Data Science, University of The Witwatersrand, Johannesburg, South Africa.
- School of Electrical and Information Engineering, University of The Witwatersrand, Johannesburg, South Africa.
ORCID-Profile: Michael Tonderai Mapundu
Zitieren
APA
Mapundu, M. T., Kabudula, C. W., Musenge, E., Olago, V., & Celik, T. (2024). Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing. PLOS ONE. https://doi.org/10.1371/journal.pone.0308452
Vancouver
Mapundu MT, Kabudula CW, Musenge E, Olago V, Celik T. Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing. PLOS ONE. 2024. doi:10.1371/journal.pone.0308452
BibTeX
@article{Mapundu2024,
author = {Mapundu, Michael Tonderai and Kabudula, Chodziwadziwa Whiteson and Musenge, Eustasius and Olago, Victor and Celik, Turgay},
title = {Text mining of verbal autopsy narratives to extract mortality causes and most prevalent diseases using natural language processing},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0308452}
}
EUVIMED