Design and Development of a Big Data Platform for Disease Burden Based on the Spark Engine
Computational Intelligence and Neuroscience · 2023
DOI: 10.1155/2023/8963053 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Intelligence and Neuroscience, 2023. Verfasst von Chengcheng Li und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Public Health and Management, Guangzhou University of Chinese Medicine, Guangzhou 510006, China. Hauptthemen laut MEDLINE: Big Data, Artificial Intelligence. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province, Social Sciences Federation of Guangdong in China.
Abstract (Originalsprache)
Objective
This study attempts to build a big data platform for disease burden that can realize the deep coupling of artificial intelligence and public health. This is a highly open and shared intelligent platform, including big data collection, analysis, and result visualization.
Methods
Based on data mining theory and technology, the current situation of multisource data on disease burden was analyzed. Putting forward the disease burden big data management model, functional modules, and technical framework, Kafka technology is used to optimize the transmission efficiency of the underlying data. This will be an efficient and highly scalable data analysis platform through embedding embedded Sparkmlib in the Hadoop ecosystem.
Results
With the concept of “Internet + medical integration,” the overall architecture design of the big data platform for disease burden management was proposed based on the Spark engine and Python language. The main system composition and application scenarios are given at four levels: multisource data collection, data processing, data analysis, and the application layer, according to application scenarios and use requirements.
Conclusion
The big data platform of disease burden management helps to promote the multisource convergence of disease burden data and provides a new path for the standardized paradigm of disease burden measurement. Provide methods and ideas for the deep integration of medical big data and the formation of a broader standard paradigm.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Public Health and Management, Guangzhou University of Chinese Medicine, Guangzhou 510006, China.
- College of Physical Education and Health, Guangxi Medical University, Nanning 530021, China.
- School of Life Science and Technology, Inner Mongolia University of Science and Technology, Baotou 014010, China.
ORCID-Profile: Shangcheng Zhou
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Guangdong Province
- Social Sciences Federation of Guangdong in China
- Hubei Provincial Department of Education
Zitieren
APA
Li, C., Gao, J., Pan, Q., Zhou, Z., Yang, Y., & Zhou, S. (2023). Design and Development of a Big Data Platform for Disease Burden Based on the Spark Engine. Computational Intelligence and Neuroscience. https://doi.org/10.1155/2023/8963053
Vancouver
Li C, Gao J, Pan Q, Zhou Z, Yang Y, Zhou S. Design and Development of a Big Data Platform for Disease Burden Based on the Spark Engine. Computational Intelligence and Neuroscience. 2023. doi:10.1155/2023/8963053
BibTeX
@article{Li2023,
author = {Li, Chengcheng and Gao, Jing and Pan, Qingwei and Zhou, Zhihua and Yang, Yue and Zhou, Shangcheng},
title = {Design and Development of a Big Data Platform for Disease Burden Based on the Spark Engine},
journal = {Computational Intelligence and Neuroscience},
year = {2023},
doi = {10.1155/2023/8963053}
}
EUVIMED