Challenges of COVID-19 Case Forecasting in the US, 2020–2021
PLOS Computational Biology · 06.05.2024 · 20 (5) · e1011200
DOI: 10.1371/journal.pcbi.1011200 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 06.05.2024. Verfasst von Velma K Lopez und 59 weiteren Autor:innen. Beteiligte Einrichtung: COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America. Hauptthemen laut MEDLINE: COVID-19, Forecasting, SARS-CoV-2, Pandemics. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC0). Gefördert von: NIAID NIH HHS, NCIRD CDC HHS, ACL HHS.
Abstract (Originalsprache)
During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub ( https://covid19forecasthub.org ). We evaluated approximately 9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1–4 weeks into the future submitted by 24 teams from August 2020 to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models, with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics. However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data, addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to inform pandemic-related decision making.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- COVID-19 Response, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America.
- University of Massachusetts, Amherst, Amherst, Massachusetts, United States of America.
- Unaffiliated, Tucson, Arizona, United States of America.
- University of Georgia, Athens, Georgia, United States of America.
- Massachusetts General Hospital, Boston, Massachusetts, United States of America.
- Georgia Institute of Technology, Atlanta, Georgia, United States of America.
ORCID-Profile: Velma K Lopez, Estee Y Cramer, Tilmann Gneiting, Jarad Niemi, Yijin Wang, Teresa K Yamana, Lei Gao, Xinyi Li, Juan Dent, Elizabeth C Lee, Joseph C Lemaitre, Kaitlin Rainwater-Lovett
Förderung
- NIAID NIH HHS
- NCIRD CDC HHS
- ACL HHS
- NIGMS NIH HHS
- National Science Foundation
- Division of Intramural Research, National Institute of Allergy and Infectious Diseases
- Andrew and Corey Morris-Singer Foundation
- Laurence H. Baker Center for Bioinformatics and Biological Statistics, Iowa State University
Zitieren
APA
Lopez, V. K., Cramer, E. Y., Pagano, R., Drake, J. M., O'Dea, E. B., Adee, M., Ayer, T., Chhatwal, J., Dalgic, O. O., Ladd, M. A., Linas, B. P., Mueller, P. P., Xiao, J., Bracher, J., Castro Rivadeneira, A. J., Gerding, A., Gneiting, T., Huang, Y., Jayawardena, D., …, & Rainwater-Lovett, K. (2024). Challenges of COVID-19 Case Forecasting in the US, 2020–2021. PLOS Computational Biology, 20(5), e1011200. https://doi.org/10.1371/journal.pcbi.1011200
Vancouver
Lopez VK, Cramer EY, Pagano R, Drake JM, O'Dea EB, Adee M, et al. Challenges of COVID-19 Case Forecasting in the US, 2020–2021. PLOS Computational Biology. 2024;20(5):e1011200. doi:10.1371/journal.pcbi.1011200
BibTeX
@article{Lopez2024,
author = {Lopez, Velma K and Cramer, Estee Y and Pagano, Robert and Drake, John M and O'Dea, Eamon B and Adee, Madeline and Ayer, Turgay and Chhatwal, Jagpreet and Dalgic, Ozden O and Ladd, Mary A and Linas, Benjamin P and Mueller, Peter P and Xiao, Jade and Bracher, Johannes and Castro Rivadeneira, Alvaro J and Gerding, Aaron and Gneiting, Tilmann and Huang, Yuxin and Jayawardena, Dasuni and Kanji, Abdul H and Le, Khoa and Mühlemann, Anja and Niemi, Jarad and Ray, Evan L and Stark, Ariane and Wang, Yijin and Wattanachit, Nutcha and Zorn, Martha W and Pei, Sen and Shaman, Jeffrey and Yamana, Teresa K and Tarasewicz, Samuel R and Wilson, Daniel J and Baccam, Sid and Gurung, Heidi and Stage, Steve and Suchoski, Brad and Gao, Lei and Gu, Zhiling and Kim, Myungjin and Li, Xinyi and Wang, Guannan and Wang, Lily and Wang, Yueying and Yu, Shan and Gardner, Lauren and Jindal, Sonia and Marshall, Maximilian and Nixon, Kristen and Dent, Juan and Hill, Alison L and Kaminsky, Joshua and Lee, Elizabeth C and Lemaitre, Joseph C and Lessler, Justin and Smith, Claire P and Truelove, Shaun and Kinsey, Matt and Mullany, Luke C and Rainwater-Lovett, Kaitlin},
title = {Challenges of COVID-19 Case Forecasting in the US, 2020–2021},
journal = {PLOS Computational Biology},
year = {2024},
volume = {20},
number = {5},
pages = {e1011200},
doi = {10.1371/journal.pcbi.1011200}
}
EUVIMED