EUVIMEDSkopri EUVIMED
Open access

Handling Missing Data in COVID-19 Incidence Estimation: Secondary Data Analysis

Hai-Thanh Pham iD, Toan Do iD, Jonggyu Baek iD, Cong-Khanh Nguyen iD, Quang-Thai Pham iD, Hoa L Nguyen iD, Robert Goldberg iD, Quang Loc Pham iD, Le Minh Giang iD

JMIR Public Health and Surveillance · 2024

DOI: 10.2196/53719 ↗

At a glance

Journal article in JMIR Public Health and Surveillance, 2024. Written by Hai-Thanh Pham and 8 co-authors. Institution: School of Preventive Medicine and Public Health, Hanoi Medical University, 1 Ton That Tung Street, Kim Lien Ward, Dong Da District, Hanoi, 100000, Vi…. Major MEDLINE topics: COVID-19. Cited 3 times so far (Crossref); 24 references. The full text is freely available in PubMed Central. Funded by: FIC NIH HHS.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Background

The COVID-19 pandemic has revealed significant challenges in disease forecasting and in developing a public health response, emphasizing the need to manage missing data from various sources in making accurate forecasts.

Objective

We aimed to show how handling missing data can affect estimates of the COVID-19 incidence rate (CIR) in different pandemic situations.

Methods

This study used data from the COVID-19/SARS-CoV-2 surveillance system at the National Institute of Hygiene and Epidemiology, Vietnam. We separated the available data set into 3 distinct periods: zero COVID-19, transition, and new normal. We randomly removed 5% to 30% of data that were missing completely at random, with a break of 5% at each time point in the variable daily caseload of COVID-19. We selected 7 analytical methods to assess the effects of handling missing data and calculated statistical and epidemiological indices to measure the effectiveness of each method.

Results

Our study examined missing data imputation performance across 3 study time periods: zero COVID-19 (n=3149), transition (n=1290), and new normal (n=9288). Imputation analyses showed that K-nearest neighbor (KNN) had the lowest mean absolute percentage change (APC) in CIR across the range (5% to 30%) of missing data. For instance, with 15% missing data, KNN resulted in 10.6%, 10.6%, and 9.7% average bias across the zero COVID-19, transition, and new normal periods, compared to 39.9%, 51.9%, and 289.7% with the maximum likelihood method. The autoregressive integrated moving average model showed the greatest mean APC in the mean number of confirmed cases of COVID-19 during each COVID-19 containment cycle (CCC) when we imputed the missing data in the zero COVID-19 period, rising from 226.3% at the 5% missing level to 6955.7% at the 30% missing level. Imputing missing data with median imputation methods had the lowest bias in the average number of confirmed cases in each CCC at all levels of missing data. In detail, in the 20% missing scenario, while median imputation had an average bias of 16.3% for confirmed cases in each CCC, which was lower than the KNN figure, maximum likelihood imputation showed a bias on average of 92.4% for confirmed cases in each CCC, which was the highest figure. During the new normal period in the 25% and 30% missing data scenarios, KNN imputation had average biases for CIR and confirmed cases in each CCC ranging from 21% to 32% for both, while maximum likelihood and moving average imputation showed biases on average above 250% for both CIR and confirmed cases in each CCC.

Conclusions

Our study emphasizes the importance of understanding that the specific imputation method used by investigators should be tailored to the specific epidemiological context and data collection environment to ensure reliable estimates of the CIR.

Subjects

MeSH terms (MEDLINE)

COVID-19HumansIncidenceVietnamData AnalysisData Interpretation, StatisticalPandemicsSecondary Data Analysis

Author keywords

COVID-19 incidence rateVietnamanalytical methodcrude RMSEcrude biasimputation methodpandemicpercentage changepopulation healthroot mean square errorsurveillance

Authors and institutions

  • School of Preventive Medicine and Public Health, Hanoi Medical University, 1 Ton That Tung Street, Kim Lien Ward, Dong Da District, Hanoi, 100000, Vietnam, 84 368-577-4236.
  • UMass Chan Medical School, University of Massachusetts Medical School, Worcester, MA, United States.
  • National Institute of Hygiene and Epidemiology, Hanoi, Vietnam.

ORCID profiles: Hai-Thanh Pham, Toan Do, Jonggyu Baek, Cong-Khanh Nguyen, Quang-Thai Pham, Hoa L Nguyen, Robert Goldberg, Quang Loc Pham, Le Minh Giang

Funding

  • FIC NIH HHS

Cite

APA

Pham, H. T., Do, T., Baek, J., Nguyen, C. K., Pham, Q. T., Nguyen, H. L., Goldberg, R., Pham, Q. L., & Giang, L. M. (2024). Handling Missing Data in COVID-19 Incidence Estimation: Secondary Data Analysis. JMIR Public Health and Surveillance. https://doi.org/10.2196/53719

Vancouver

Pham HT, Do T, Baek J, Nguyen CK, Pham QT, Nguyen HL, et al. Handling Missing Data in COVID-19 Incidence Estimation: Secondary Data Analysis. JMIR Public Health and Surveillance. 2024. doi:10.2196/53719

BibTeX
@article{Pham2024,
  author = {Pham, Hai-Thanh and Do, Toan and Baek, Jonggyu and Nguyen, Cong-Khanh and Pham, Quang-Thai and Nguyen, Hoa L and Goldberg, Robert and Pham, Quang Loc and Giang, Le Minh},
  title = {Handling Missing Data in COVID-19 Incidence Estimation: Secondary Data Analysis},
  journal = {JMIR Public Health and Surveillance},
  year = {2024},
  doi = {10.2196/53719}
}
Start for free →