Modal-Adaptive Spatial-Aware-Fusion and Propagation Network for Multimodal Vision Crowd Counting
IEEE Transactions on Consumer Electronics · 2025-05 · 71 (2) · 3605-3616
DOI: 10.1109/tce.2025.3571571 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-05. Verfasst von Kai Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
With the rapid development of AI and deep learning technologies, smart consumer electronic devices integrate a variety of sensors, especially thermal imaging or depth imaging technology. Some researchers became keen to explore multimodal vision crowd counting techniques based on RGB-thermal or RGB-depth images. However, existing multimodal counting methods ignore the unique contribution of each modality and the effective propagation of features while achieving multimodal fusion. To address these issues, we propose a Modal-adaptive Spatial-aware-fusion and Propagation Network (MSPNet) for multimodal crowd counting. First, we design a coarse-fine cross-modal dynamic fusion (CCDF) module, which fully captures modality-specific and modality-shared information in different semantic spaces using a spatial activation function-guided fine-grained adaptive weighted fusion mechanism. Then, we adopt adapted different convolutions to channel concatenate the features output by multi-stage CCDF. Finally, considering the visual differences of the same object under different imaging angles, we design a dual-dilation adaptive feed-forward propagation module constructed by the dual dilation transposed attention and the feed-forward neural network improved by the gating mechanism to effectively propagate the enhanced multi-modal fusion features to the counting regression module. Experimental results show that MSPNet outperforms the existing state-of-the-art methods on two multimodal crowd counting datasets ShanghaiTechRGBD and RGBT-CC.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Liu, K., Zou, X., Zhu, P., & Sang, J. (2025). Modal-Adaptive Spatial-Aware-Fusion and Propagation Network for Multimodal Vision Crowd Counting. IEEE Transactions on Consumer Electronics, 71(2), 3605-3616. https://doi.org/10.1109/tce.2025.3571571
Vancouver
Liu K, Zou X, Zhu P, Sang J. Modal-Adaptive Spatial-Aware-Fusion and Propagation Network for Multimodal Vision Crowd Counting. IEEE Transactions on Consumer Electronics. 2025;71(2):3605-3616. doi:10.1109/tce.2025.3571571
BibTeX
@article{Liu2025,
author = {Liu, Kai and Zou, Xuetao and Zhu, Peng and Sang, Jun},
title = {Modal-Adaptive Spatial-Aware-Fusion and Propagation Network for Multimodal Vision Crowd Counting},
journal = {IEEE Transactions on Consumer Electronics},
year = {2025},
volume = {71},
number = {2},
pages = {3605--3616},
doi = {10.1109/tce.2025.3571571}
}
EUVIMED