Mutual Information Regularization for Weakly-Supervised RGB-D Salient Object Detection
IEEE Transactions on Circuits and Systems for Video Technology · 2024-01 · 34 (1) · 397-410
DOI: 10.1109/tcsvt.2023.3285249 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-01. Verfasst von Aixuan Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 54-mal zitiert (Crossref) und nennt 132 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
In this paper, we present a weakly-supervised RGB-D salient object detection model via scribble supervision. Specifically, as a multimodal learning task, we focus on effective multimodal representation learning via inter-modal mutual information regularization. In particular, following the principle of disentangled representation learning, we introduce a mutual information upper bound with a mutual information minimization regularizer to encourage the disentangled representation of each modality for salient object detection. Based on our multimodal representation learning framework, we introduce an asymmetric feature extractor for our multimodal data, which is proven more effective than the conventional symmetric backbone setting. We also introduce multimodal variational auto-encoder as stochastic prediction refinement techniques, which takes pseudo labels from the first training stage as supervision and generates refined prediction. Experimental results on benchmark RGB-D salient object detection datasets verify both effectiveness of our explicit multimodal disentangled representation learning method and the stochastic prediction refinement strategy, achieving comparable performance with the state-of-the-art fully supervised models. Our code and data are available at: https://npucvr.github.io/MIRV/.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Li, A., Mao, Y., Zhang, J., & Dai, Y. (2024). Mutual Information Regularization for Weakly-Supervised RGB-D Salient Object Detection. IEEE Transactions on Circuits and Systems for Video Technology, 34(1), 397-410. https://doi.org/10.1109/tcsvt.2023.3285249
Vancouver
Li A, Mao Y, Zhang J, Dai Y. Mutual Information Regularization for Weakly-Supervised RGB-D Salient Object Detection. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(1):397-410. doi:10.1109/tcsvt.2023.3285249
BibTeX
@article{Li2024,
author = {Li, Aixuan and Mao, Yuxin and Zhang, Jing and Dai, Yuchao},
title = {Mutual Information Regularization for Weakly-Supervised RGB-D Salient Object Detection},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {1},
pages = {397--410},
doi = {10.1109/tcsvt.2023.3285249}
}
EUVIMED