EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Spatial–Temporal Transformer Networks for Traffic Flow Forecasting Using a Pre-Trained Language Model

Ju Ma, Juan Zhao iD, Yao Hou

Sensors · 25.08.2024 · 24 (17) · 5502

DOI: 10.3390/s24175502 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 25.08.2024. Verfasst von Ju Ma und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most current methods use spatial–temporal graph neural networks (STGNNs) to analyze complex spatial–temporal information from traffic data collected from hundreds of sensors. STGNNs combine graph neural networks (GNNs) and sequence models to create hybrid structures that allow for the two networks to collaborate. However, this collaboration has made the model increasingly complex. This study proposes a framework that relies solely on original Transformer architecture and carefully designs embeddings to efficiently extract spatial–temporal dependencies in traffic flow. Additionally, we used pre-trained language models to enhance forecasting performance. We compared our new framework with current state-of-the-art STGNNs and Transformer-based models using four real-world traffic datasets: PEMS04, PEMS08, METR-LA, and PEMS-BAY. The experimental results demonstrate that our framework outperforms the other models in most metrics.

Schlagwörter

Stichwörter der Autor:innen

LLMsTransformerspatial–temporal dependencytraffic flow forecasting

Autor:innen und Institutionen

  • School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China.

ORCID-Profile: Juan Zhao

Zitieren

APA

Ma, J., Zhao, J., & Hou, Y. (2024). Spatial–Temporal Transformer Networks for Traffic Flow Forecasting Using a Pre-Trained Language Model. Sensors, 24(17), 5502. https://doi.org/10.3390/s24175502

Vancouver

Ma J, Zhao J, Hou Y. Spatial–Temporal Transformer Networks for Traffic Flow Forecasting Using a Pre-Trained Language Model. Sensors. 2024;24(17):5502. doi:10.3390/s24175502

BibTeX
@article{Ma2024,
  author = {Ma, Ju and Zhao, Juan and Hou, Yao},
  title = {Spatial–Temporal Transformer Networks for Traffic Flow Forecasting Using a Pre-Trained Language Model},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {17},
  pages = {5502},
  doi = {10.3390/s24175502}
}
Kostenlos starten →