Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-11 · 47 (11) · 9994-10011
DOI: 10.1109/tpami.2025.3590242 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-11. Verfasst von Chizhuo Xiao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 64 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province, SERC Central Research Fund.
Abstract (Originalsprache)
Weakly supervised video anomaly detection has gained attention for its effective performance and cost-efficient annotation, using video-level labels to distinguish between normal and abnormal patterns. However, challenges arise from the diversity and incompleteness of anomalous events, complicating feature learning. Vision-language models offer promising approaches, but designing precise prompts remains difficult. This is because accommodating the diverse range of normal and anomalous scenarios in real-world settings is challenging, and the workload is significant. To tackle these issues, we propose integrating multilingualism and multiple prompts to improve feature learning. By utilizing prompts in various languages to define "anomaly" and "normalcy," we tackle these concepts across different linguistic domains. In each domain, multiple prompts are employed for adaptive top-K prompt selection of snippets. To enhance visual feature learning, a multi-granularity attention module combining Transformer and Mamba is designed. Mamba's long-range adaptation selection builds fine-grained temporal correlations among coarse-grained snippets, while Transformer enhances fine-grained information guided by coarse-grained information. Alongside a multilingual prompt guidance loss, we introduce a gradual directional loss to jointly optimize visual feature distribution and the top-K prompt selection. Our method demonstrates effectiveness on four video datasets and provides generalizability analyses on two medical datasets, including EMG and ECG temporal data.
Förderung
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
- SERC Central Research Fund
Zitieren
APA
Xiao, C., Xiao, Y., Zhou, J. T., & Fang, Z. (2025). Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(11), 9994-10011. https://doi.org/10.1109/tpami.2025.3590242
Vancouver
Xiao C, Xiao Y, Zhou JT, Fang Z. Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(11):9994-10011. doi:10.1109/tpami.2025.3590242
BibTeX
@article{Xiao2025,
author = {Xiao, Chizhuo and Xiao, Yang and Zhou, Joey Tianyi and Fang, Zhiwen},
title = {Multilingual-Prompt-Guided Directional Feature Learning for Weakly Supervised Video Anomaly Detection},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {11},
pages = {9994--10011},
doi = {10.1109/tpami.2025.3590242}
}
EUVIMED