EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction

Kun Peng, Shanke Li, Fei Hui, Xiyao Liu

Journal of Advanced Transportation · 2026-01 · 2026 (1)

DOI: 10.1155/atr/4985228 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Advanced Transportation, online erschienen am 13.05.2026. Verfasst von Kun Peng und 3 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Key Research and Development Projects of Shaanxi Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Extracting critical scenarios from the vast and complex driving environments is a crucial step in the iterative upgrade process of autonomous driving systems. Existing image–text‐based retrieval methods provide a good understanding of the environment but overlook the critical information regarding the impact of the environment on the self‐vehicle. To address these issues, we propose a contrastive image–text–motion retrieval (CITMR) cross‐modal learning framework that uses descriptive text as input to retrieve critical scenarios. The framework employs image, text, and motion encoders to extract features from different modalities and uses contrastive loss to enable cross‐modal information comparison and interaction. Finally, the vehicle’s motion and its textual description are supplemented in the collected autonomous driving dataset, and a scenario dataset containing image–text–motion pairs is constructed for model validation. Experimental results show that CITMR achieves retrieval performance for text‐critical scenarios of 0.8684 and 0.8557 on two test datasets, outperforming the baseline methods.

Förderung

  • National Natural Science Foundation of China
  • Key Research and Development Projects of Shaanxi Province

Zitieren

APA

Peng, K., Li, S., Hui, F., & Liu, X. (2026). CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction. Journal of Advanced Transportation, 2026(1). https://doi.org/10.1155/atr/4985228

Vancouver

Peng K, Li S, Hui F, Liu X. CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction. Journal of Advanced Transportation. 2026;2026(1). doi:10.1155/atr/4985228

BibTeX
@article{Peng2026,
  author = {Peng, Kun and Li, Shanke and Hui, Fei and Liu, Xiyao},
  title = {CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction},
  journal = {Journal of Advanced Transportation},
  year = {2026},
  volume = {2026},
  number = {1},
  doi = {10.1155/atr/4985228}
}
Kostenlos starten →