EUVIMEDScopri EUVIMED
Crossref

A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data

Xin Zhao iD, Xiaokai Nie, Yu Zhao, Kaida Cai iD

Statistics in Medicine · 2025

DOI: 10.1002/sim.70332 ↗

At a glance

Journal article in Statistics in Medicine, 2025. Written by Xin Zhao and 3 co-authors. Institution: School of Mathematics, Southeast University, Nanjing, People's Republic of China. Major MEDLINE topics: Algorithms. 42 references. Funded by: Southeast University Zhishan Youth Scholar Foundation, Nanjing Scientific and Technological Innovation Foundation for Selected Returned Overseas Chinese Scholars, Jiangsu Province Foundation for Innovative and Entrepreneurial Doctor.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

In streaming longitudinal data, status prediction becomes challenging when input variables are block‐sparse, autocorrelated, and irregular in both dimension and distribution. General methods cannot model such data directly, especially when the classes are extremely imbalanced. This research proposes a K‐Nearest Neighbor (KNN) algorithm where distance is measured by Kullback–Leibler (KL) divergence. The algorithm uses features extracted from metric conditional density, both with and without first‐order lag. The developed streaming KNN algorithm is further applied to simulation data. Results show that when differences originate from the location hyperparameters of the Gaussian distribution or both the shape and scale hyperparameters of the inverse gamma distribution, the method performs quite well, as expected, with an AUC close to 1. Additionally, a numerical method is proposed for general distributions that lack an analytical expression in real data. This method is applied to a big medical streaming dataset with similar properties. Results indicate that the AUC value gradually increases to 0.913, with a sensitivity of 0.851 and a specificity of 0.816.

Subjects

MeSH terms (MEDLINE)

AlgorithmsLongitudinal StudiesHumansComputer SimulationArea Under CurveModels, StatisticalNormal Distribution

Author keywords

KL divergenceKNNautocorrelationblock‐sparse datastreaming longitudinal data

Authors and institutions

  • School of Mathematics, Southeast University, Nanjing, People's Republic of China.
  • School of Automation, Southeast University, Nanjing, People's Republic of China.
  • Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education, Southeast University, Nanjing, People's Republic of China.
  • Shenzhen Research Institute, Southeast University, Shenzhen, People's Republic of China.
  • Department of Anesthesiology, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, People's Republic of China.
  • Department of Epidemiology and Biostatistics, Southeast University, Nanjing, People's Republic of China.

ORCID profiles: Xin Zhao, Kaida Cai

Funding

  • Southeast University Zhishan Youth Scholar Foundation
  • Nanjing Scientific and Technological Innovation Foundation for Selected Returned Overseas Chinese Scholars
  • Jiangsu Province Foundation for Innovative and Entrepreneurial Doctor
  • National Natural Science Foundation of China
  • Jiangsu Provincial Scientific Research Center of Applied Mathematics
  • Natural Science Foundation of Jiangsu Province
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • Southeast University Global Engagement of Excellence Fund

Cite

APA

Zhao, X., Nie, X., Zhao, Y., & Cai, K. (2025). A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data. Statistics in Medicine. https://doi.org/10.1002/sim.70332

Vancouver

Zhao X, Nie X, Zhao Y, Cai K. A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data. Statistics in Medicine. 2025. doi:10.1002/sim.70332

BibTeX
@article{Zhao2025,
  author = {Zhao, Xin and Nie, Xiaokai and Zhao, Yu and Cai, Kaida},
  title = {A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data},
  journal = {Statistics in Medicine},
  year = {2025},
  doi = {10.1002/sim.70332}
}
Start for free →