EUVIMEDEUVIMED entdecken
Crossref

Bidirectional Semi-Supervised Dual-Branch CNN for Robust 3D Reconstruction of Stereo Endoscopic Images via Adaptive Cross and Parallel Supervisions

Hongkuan Shi, Zhiwei Wang, Ying Zhou, Dun Li, Xin Yang, Qiang Li

IEEE Transactions on Medical Imaging · 2023

DOI: 10.1109/tmi.2023.3279899 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2023. Verfasst von Hongkuan Shi und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional, Endoscopy. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, Fundamental Research Funds for the Central Universities.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Semi-supervised learning via teacher-student network can train a model effectively on a few labeled samples. It enables a student model to distill knowledge from the teacher's predictions of extra unlabeled data. However, such knowledge flow is typically unidirectional, having the accuracy vulnerable to the quality of teacher model. In this paper, we seek to robust 3D reconstruction of stereo endoscopic images by proposing a novel fashion of bidirectional learning between two learners, each of which can play both roles of teacher and student concurrently. Specifically, we introduce two self-supervisions, i.e., Adaptive Cross Supervision (ACS) and Adaptive Parallel Supervision (APS), to learn a dual-branch convolutional neural network. The two branches predict two different disparity probability distributions for the same position, and output their expectations as disparity values. The learned knowledge flows across branches along two directions: a cross direction (disparity guides distribution in ACS) and a parallel direction (disparity guides disparity in APS). Moreover, each branch also learns confidences to dynamically refine its provided supervisions. In ACS, the predicted disparity is softened into a unimodal distribution, and the lower the confidence, the smoother the distribution. In APS, the incorrect predictions are suppressed by lowering the weights of those with low confidence. With the adaptive bidirectional learning, the two branches enjoy well-tuned mutual supervisions, and eventually converge on a consistent and more accurate disparity estimation. The experimental results on four public datasets demonstrate our superior accuracy over other state-of-the-arts with a relative decrease of averaged disparity error by at least 9.76%.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Imaging, Three-DimensionalEndoscopyHumansNeural Networks, ComputerProbabilitySupervised Machine Learning

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China
  • Fundamental Research Funds for the Central Universities
  • Research Grants from Wuhan United Imaging Healthcare Surgical Technology Company Ltd

Zitieren

APA

Shi, H., Wang, Z., Zhou, Y., Li, D., Yang, X., & Li, Q. (2023). Bidirectional Semi-Supervised Dual-Branch CNN for Robust 3D Reconstruction of Stereo Endoscopic Images via Adaptive Cross and Parallel Supervisions. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2023.3279899

Vancouver

Shi H, Wang Z, Zhou Y, Li D, Yang X, Li Q. Bidirectional Semi-Supervised Dual-Branch CNN for Robust 3D Reconstruction of Stereo Endoscopic Images via Adaptive Cross and Parallel Supervisions. IEEE Transactions on Medical Imaging. 2023. doi:10.1109/tmi.2023.3279899

BibTeX
@article{Shi2023,
  author = {Shi, Hongkuan and Wang, Zhiwei and Zhou, Ying and Li, Dun and Yang, Xin and Li, Qiang},
  title = {Bidirectional Semi-Supervised Dual-Branch CNN for Robust 3D Reconstruction of Stereo Endoscopic Images via Adaptive Cross and Parallel Supervisions},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2023},
  doi = {10.1109/tmi.2023.3279899}
}
Kostenlos starten →