A Survey on Spatio-Temporal Prediction: From Transformers to Foundation Models
ACM Computing Surveys · 31.03.2026 · 58 (4) · 1-36
DOI: 10.1145/3766546 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 06.10.2025. Verfasst von Yingchi Mao und 11 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 164 Literaturangaben. Gefördert von: Key Research and Development Program of China, Technology Talent and Platform Program of Yunnan Province, Technology Project of Huaneng Group.
Abstract (Originalsprache)
Spatio-Temporal (ST) data is pervasive on the various aspects in our daily lives. By mining the ST information from the data, we are able to predict trends in numerous domains. The Transformer and one of its more recent enhancements, foundation models, have achieved a remarkable success in such ST prediction. In this article, we first survey the state of the art of Transformers-related work, then introduce the network architecture of the Transformer and summarize the improvements to adapt to the ST prediction Transformer and foundation models, including module enhancement and adjustment. Subsequently, we categorize the ST Transformer and foundation models in selected applications in some relevant domains, mainly urban transportation, climate monitoring, and motion prediction. Next, we propose an evaluation method in the ST prediction with Transformers and foundation models, list the most relevant open-source datasets, evaluation metrics and performance analysis. Finally, we discuss some future directions on the task of ST prediction with Transformer and foundation models. Relevant papers and open-source resources have been collated and are continuously updated at: https://github.com/cyhforlight/Spatio-Temporal-Prediction-Transformer-Review .
Förderung
- Key Research and Development Program of China
- Technology Talent and Platform Program of Yunnan Province
- Technology Project of Huaneng Group
- High Performance Computing Platform, Hohai University
- Brazilian National Council for Scientific and Technological Development - CNPq
Zitieren
APA
Mao, Y., Zhou, H., Chen, L., Qi, R., Sun, Z., Rong, Y., He, X., Chen, M., Mumtaz, S., Frascolla, V., Guizani, M., & Rodrigues, J. (2026). A Survey on Spatio-Temporal Prediction: From Transformers to Foundation Models. ACM Computing Surveys, 58(4), 1-36. https://doi.org/10.1145/3766546
Vancouver
Mao Y, Zhou H, Chen L, Qi R, Sun Z, Rong Y, et al. A Survey on Spatio-Temporal Prediction: From Transformers to Foundation Models. ACM Computing Surveys. 2026;58(4):1-36. doi:10.1145/3766546
BibTeX
@article{Mao2026,
author = {Mao, Yingchi and Zhou, Hongliang and Chen, Ling and Qi, Rongzhi and Sun, Zhende and Rong, Yi and He, Xiaoming and Chen, Mingkai and Mumtaz, Shahid and Frascolla, Valerio and Guizani, Mohsen and Rodrigues, Joel},
title = {A Survey on Spatio-Temporal Prediction: From Transformers to Foundation Models},
journal = {ACM Computing Surveys},
year = {2026},
volume = {58},
number = {4},
pages = {1--36},
doi = {10.1145/3766546}
}
EUVIMED