PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networks
SIAM Journal on Imaging Sciences · 31.03.2024 · 17 (1) · 540-594
DOI: 10.1137/23m1586355 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Imaging Sciences, online erschienen am 07.03.2024. Verfasst von Xue-Cheng Tai und 2 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 75 Literaturangaben. Gefördert von: NORCE Kompetanseoppbygging program, CRF, City University of Hong Kong.
Abstract (Originalsprache)
For problems in image processing and many other fields, a large class of effective neural networks has encoder-decoder-based architectures. Although these networks have shown impressive performance, mathematical explanations of their architectures are still underdeveloped. In this paper, we study the encoder-decoder-based network architecture from the algorithmic perspective and provide a mathematical explanation. We use the two-phase Potts model for image segmentation as an example for our explanations. We associate the segmentation problem with a control problem in the continuous setting. Then, the continuous control model is time discretized by an operator-splitting scheme, the PottsMGNet, and space discretized by the multigrid method. We show that the resulting discrete PottsMGNet is equivalent to an encoder-decoder-based network. With minor modifications, it is shown that a number of the popular encoder-decoder-based neural networks are just instances of the proposed PottsMGNet. By incorporating the soft-threshold-dynamics into the PottsMGNet as a regularizer, the PottsMGNet has shown to be robust with the network parameters such as network width and depth and has achieved remarkable performance on datasets with very large noise. In nearly all our experiments, the new network always performs better than or as well as on accuracy and dice score compared to existing networks for image segmentation.
Förderung
- NORCE Kompetanseoppbygging program
- CRF
- City University of Hong Kong
- Hong Kong Baptist University
- National Natural Science Foundation of China
- HKRGC ECS
- HKRGC CRF
- HKRGC-NSFC
Zitieren
APA
Tai, X., Liu, H., & Chan, R. (2024). PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networks. SIAM Journal on Imaging Sciences, 17(1), 540-594. https://doi.org/10.1137/23m1586355
Vancouver
Tai X, Liu H, Chan R. PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networks. SIAM Journal on Imaging Sciences. 2024;17(1):540-594. doi:10.1137/23m1586355
BibTeX
@article{Tai2024,
author = {Tai, Xue-Cheng and Liu, Hao and Chan, Raymond},
title = {PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networks},
journal = {SIAM Journal on Imaging Sciences},
year = {2024},
volume = {17},
number = {1},
pages = {540--594},
doi = {10.1137/23m1586355}
}
EUVIMED