EUVIMEDEUVIMED entdecken
Crossref

Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Network

Xiang Fang, Wanlong Fang, Changshuo Wang, Daizong Liu, Keke Tang, Jianfeng Dong, Pan Zhou, Beibei Li

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (3) · 2915-2923

DOI: 10.1609/aaai.v39i3.32298 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Xiang Fang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Given some video-query pairs with untrimmed videos and sentence queries, temporal sentence grounding (TSG) aims to locate query-relevant segments in these videos. Although previous respectable TSG methods have achieved remarkable success, they train each video-query pair separately and ignore the relationship between different pairs. To this end, in this paper, we pose a brand-new setting: Multi-Pair TSG, which aims to co-train these pairs. We propose a novel video-query co-training approach, Multi-Thread Knowledge Transfer Network, to locate a variety of video-query pairs effectively and efficiently. Firstly, we mine the spatial and temporal semantics across different queries to cooperate with each other. To learn intra- and inter-modal representations simultaneously, we design a cross-modal contrast module to explore the semantic consistency by a self-supervised strategy. To fully align visual and textual representations between different pairs, we design a prototype alignment strategy to 1) match object prototypes and phrase prototypes for spatial alignment, and 2) align activity prototypes and sentence prototypes for temporal alignment. Finally, we develop an adaptive negative selection module to adaptively generate a threshold for cross-modal matching. Extensive experiments show the effectiveness and efficiency of our proposed method.

Zitieren

APA

Fang, X., Fang, W., Wang, C., Liu, D., Tang, K., Dong, J., Zhou, P., & Li, B. (2025). Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Network. Proceedings of the AAAI Conference on Artificial Intelligence, 39(3), 2915-2923. https://doi.org/10.1609/aaai.v39i3.32298

Vancouver

Fang X, Fang W, Wang C, Liu D, Tang K, Dong J, et al. Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Network. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(3):2915-2923. doi:10.1609/aaai.v39i3.32298

BibTeX
@article{Fang2025,
  author = {Fang, Xiang and Fang, Wanlong and Wang, Changshuo and Liu, Daizong and Tang, Keke and Dong, Jianfeng and Zhou, Pan and Li, Beibei},
  title = {Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Network},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {3},
  pages = {2915--2923},
  doi = {10.1609/aaai.v39i3.32298}
}
Kostenlos starten →