EUVIMEDEUVIMED entdecken
Crossref

Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection

Chizhuo Xiao, Yang Xiao, Joey Tianyi Zhou, Zhiwen Fang

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-11 · 47 (11) · 9994-10011

DOI: 10.1109/tpami.2025.3590242 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-11. Verfasst von Chizhuo Xiao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 64 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province, SERC Central Research Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Weakly supervised video anomaly detection has gained attention for its effective performance and cost-efficient annotation, using video-level labels to distinguish between normal and abnormal patterns. However, challenges arise from the diversity and incompleteness of anomalous events, complicating feature learning. Vision-language models offer promising approaches, but designing precise prompts remains difficult. This is because accommodating the diverse range of normal and anomalous scenarios in real-world settings is challenging, and the workload is significant. To tackle these issues, we propose integrating multilingualism and multiple prompts to improve feature learning. By utilizing prompts in various languages to define "anomaly" and "normalcy," we tackle these concepts across different linguistic domains. In each domain, multiple prompts are employed for adaptive top-K prompt selection of snippets. To enhance visual feature learning, a multi-granularity attention module combining Transformer and Mamba is designed. Mamba's long-range adaptation selection builds fine-grained temporal correlations among coarse-grained snippets, while Transformer enhances fine-grained information guided by coarse-grained information. Alongside a multilingual prompt guidance loss, we introduce a gradual directional loss to jointly optimize visual feature distribution and the top-K prompt selection. Our method demonstrates effectiveness on four video datasets and provides generalizability analyses on two medical datasets, including EMG and ECG temporal data.

Förderung

  • National Natural Science Foundation of China
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • SERC Central Research Fund

Zitieren

APA

Xiao, C., Xiao, Y., Zhou, J. T., & Fang, Z. (2025). Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(11), 9994-10011. https://doi.org/10.1109/tpami.2025.3590242

Vancouver

Xiao C, Xiao Y, Zhou JT, Fang Z. Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(11):9994-10011. doi:10.1109/tpami.2025.3590242

BibTeX
@article{Xiao2025,
  author = {Xiao, Chizhuo and Xiao, Yang and Zhou, Joey Tianyi and Fang, Zhiwen},
  title = {Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {11},
  pages = {9994--10011},
  doi = {10.1109/tpami.2025.3590242}
}
Kostenlos starten →