EUVIMEDEUVIMED entdecken
Crossref

Differential Modal Multistage Adaptive Fusion Networks via Knowledge Distillation for RGB-D Mirror Segmentation

Wujie Zhou, Han Zhang, Weiwei Qiu

IEEE Transactions on Big Data · 2025-08 · 11 (4) · 1959-1969

DOI: 10.1109/tbdata.2024.3505057 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Big Data, 2025-08. Verfasst von Wujie Zhou und 2 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Mirrors play a significant role in our daily lives and are ubiquitous. However, deep learning computer vision models find them challenging owing to the negative impact of reflected information on scene understanding. This study addresses two key challenges faced by multimodal models. First, the cross-modal variability of features at different stages is generally overlooked by contemporary backbone networks. Second, good performance has only been achieved at an unacceptable computational expense, owing to the numerous parameters used. To address the first challenge, we propose a differential-mode multistage adaptive fusion network (differential mode refers to images generated by different sensors that are differentiated to complement each other) that incorporates two-step fusion in the coding stage to account for the degrees of difference among the cross-modal features. In the first stage, wherein considerable differences in modal features exist, multi-angle fusion is performed. In the second stage, wherein the differences are smaller, a hierarchical adaptive fusion strategy is employed. Regarding the second challenge, we introduce a companion training framework for mirror segmentation that combines knowledge distillation and contrastive learning. Our proposed scheme achieves state-of-the-art performance on an available mirror segmentation dataset without requiring numerous parameters.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhou, W., Zhang, H., & Qiu, W. (2025). Differential Modal Multistage Adaptive Fusion Networks via Knowledge Distillation for RGB-D Mirror Segmentation. IEEE Transactions on Big Data, 11(4), 1959-1969. https://doi.org/10.1109/tbdata.2024.3505057

Vancouver

Zhou W, Zhang H, Qiu W. Differential Modal Multistage Adaptive Fusion Networks via Knowledge Distillation for RGB-D Mirror Segmentation. IEEE Transactions on Big Data. 2025;11(4):1959-1969. doi:10.1109/tbdata.2024.3505057

BibTeX
@article{Zhou2025,
  author = {Zhou, Wujie and Zhang, Han and Qiu, Weiwei},
  title = {Differential Modal Multistage Adaptive Fusion Networks via Knowledge Distillation for RGB-D Mirror Segmentation},
  journal = {IEEE Transactions on Big Data},
  year = {2025},
  volume = {11},
  number = {4},
  pages = {1959--1969},
  doi = {10.1109/tbdata.2024.3505057}
}
Kostenlos starten →