A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data
Statistics in Medicine · 2025
DOI: 10.1002/sim.70332 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistics in Medicine, 2025. Verfasst von Xin Zhao und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematics, Southeast University, Nanjing, People's Republic of China. Hauptthemen laut MEDLINE: Algorithms. Die Arbeit nennt 42 Literaturangaben. Gefördert von: Southeast University Zhishan Youth Scholar Foundation, Nanjing Scientific and Technological Innovation Foundation for Selected Returned Overseas Chinese Scholars, Jiangsu Province Foundation for Innovative and Entrepreneurial Doctor.
Abstract (Originalsprache)
In streaming longitudinal data, status prediction becomes challenging when input variables are block‐sparse, autocorrelated, and irregular in both dimension and distribution. General methods cannot model such data directly, especially when the classes are extremely imbalanced. This research proposes a K‐Nearest Neighbor (KNN) algorithm where distance is measured by Kullback–Leibler (KL) divergence. The algorithm uses features extracted from metric conditional density, both with and without first‐order lag. The developed streaming KNN algorithm is further applied to simulation data. Results show that when differences originate from the location hyperparameters of the Gaussian distribution or both the shape and scale hyperparameters of the inverse gamma distribution, the method performs quite well, as expected, with an AUC close to 1. Additionally, a numerical method is proposed for general distributions that lack an analytical expression in real data. This method is applied to a big medical streaming dataset with similar properties. Results indicate that the AUC value gradually increases to 0.913, with a sensitivity of 0.851 and a specificity of 0.816.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mathematics, Southeast University, Nanjing, People's Republic of China.
- School of Automation, Southeast University, Nanjing, People's Republic of China.
- Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education, Southeast University, Nanjing, People's Republic of China.
- Shenzhen Research Institute, Southeast University, Shenzhen, People's Republic of China.
- Department of Anesthesiology, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, People's Republic of China.
- Department of Epidemiology and Biostatistics, Southeast University, Nanjing, People's Republic of China.
Förderung
- Southeast University Zhishan Youth Scholar Foundation
- Nanjing Scientific and Technological Innovation Foundation for Selected Returned Overseas Chinese Scholars
- Jiangsu Province Foundation for Innovative and Entrepreneurial Doctor
- National Natural Science Foundation of China
- Jiangsu Provincial Scientific Research Center of Applied Mathematics
- Natural Science Foundation of Jiangsu Province
- Basic and Applied Basic Research Foundation of Guangdong Province
- Southeast University Global Engagement of Excellence Fund
Zitieren
APA
Zhao, X., Nie, X., Zhao, Y., & Cai, K. (2025). A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data. Statistics in Medicine. https://doi.org/10.1002/sim.70332
Vancouver
Zhao X, Nie X, Zhao Y, Cai K. A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data. Statistics in Medicine. 2025. doi:10.1002/sim.70332
BibTeX
@article{Zhao2025,
author = {Zhao, Xin and Nie, Xiaokai and Zhao, Yu and Cai, Kaida},
title = {A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data},
journal = {Statistics in Medicine},
year = {2025},
doi = {10.1002/sim.70332}
}
EUVIMED