Can AI weather models predict out-of-distribution gray swan tropical cyclones?
Proceedings of the National Academy of Sciences · 27.05.2025 · 122 (21)
DOI: 10.1073/pnas.2420914122 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 20.05.2025. Verfasst von Y Qiang Sun und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of the Geophysical Sciences, University of Chicago, Chicago, IL 60637. Die Arbeit wurde bisher 57-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: DOD | USN | Office of Naval Research (ONR), DOD | USA | AFC | CCDC | Army Research Office (ARO), NSF | GEO | Division of Atmospheric and Geospace Sciences (AGS).
Abstract (Originalsprache)
Predicting gray swan weather extremes, which are possible but so rare that they are absent from the training dataset, is a major concern for AI weather models and long-term climate emulators. An important open question is whether AI models can extrapolate from weaker weather events present in the training set to stronger, unseen weather extremes. To test this, we train independent versions of the AI weather model FourCastNet on the 1979–2015 ERA5 dataset with all data, or with Category 3–5 tropical cyclones (TCs) removed, either globally or only over the North Atlantic or Western Pacific basin. We then test these versions of FourCastNet on 2018–2023 Category 5 TCs (gray swans). All versions yield similar accuracy for global weather, but the one trained without Category 3–5 TCs cannot accurately forecast Category 5 TCs, indicating that these models cannot extrapolate from weaker storms. The versions trained without Category 3–5 TCs in one basin show some skill forecasting Category 5 TCs in that basin, suggesting that FourCastNet can generalize across tropical basins. This is encouraging and surprising because regional information is implicitly encoded in inputs. Given that current state-of-the-art AI weather and climate models have similar learning strategies, we expect our findings to apply to other models. Other types of weather extremes need to be similarly investigated. Our work demonstrates that novel learning strategies are needed for AI models to reliably provide early warning or estimated statistics for the rarest, most impactful TCs, and, possibly, other weather extremes.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of the Geophysical Sciences, University of Chicago, Chicago, IL 60637.
- Committee on Computational and Applied Mathematics, Division of the Physical Sciences, University of Chicago, Chicago, IL 60637.
- Research Computing Center, The Office of the Provost, University of Chicago, Chicago, IL 60637.
- Department of Applied Mathematics, University of California, Santa Cruz, CA 95064.
- Courant Institute of Mathematical Sciences, New York University, New York, NY 10012.
ORCID-Profile: Y Qiang Sun, Ashesh Chattopadhyay, Jonathan Weare
Förderung
- DOD | USN | Office of Naval Research (ONR)
- DOD | USA | AFC | CCDC | Army Research Office (ARO)
- NSF | GEO | Division of Atmospheric and Geospace Sciences (AGS)
Zitieren
APA
Sun, Y. Q., Hassanzadeh, P., Zand, M., Chattopadhyay, A., Weare, J., & Abbot, D. S. (2025). Can AI weather models predict out-of-distribution gray swan tropical cyclones?. Proceedings of the National Academy of Sciences, 122(21). https://doi.org/10.1073/pnas.2420914122
Vancouver
Sun YQ, Hassanzadeh P, Zand M, Chattopadhyay A, Weare J, Abbot DS. Can AI weather models predict out-of-distribution gray swan tropical cyclones?. Proceedings of the National Academy of Sciences. 2025;122(21). doi:10.1073/pnas.2420914122
BibTeX
@article{Sun2025,
author = {Sun, Y Qiang and Hassanzadeh, Pedram and Zand, Mohsen and Chattopadhyay, Ashesh and Weare, Jonathan and Abbot, Dorian S},
title = {Can AI weather models predict out-of-distribution gray swan tropical cyclones?},
journal = {Proceedings of the National Academy of Sciences},
year = {2025},
volume = {122},
number = {21},
doi = {10.1073/pnas.2420914122}
}
EUVIMED