Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation
IEEE Transactions on Biomedical Engineering · 2025
DOI: 10.1109/tbme.2024.3467216 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2025. Verfasst von Dehui Xiang und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Tomography, X-Ray Computed, Multimodal Imaging, Machine Learning. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of the Jiangsu Higher Education Institutions of China, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
OBJECTIVE: Multi-modal MR/CT image segmentation is an important task in disease diagnosis and treatment, but it is usually difficult to acquire aligned multi-modal images of a patient in clinical practice due to the high cost and specific allergic reactions to contrast agents. To address these issues, a task complementation framework is proposed to enable unpaired multi-modal image complementation learning in the training stage and single-modal image segmentation in the inference stage. METHOD: To fuse unpaired dual-modal images in the training stage and allow single-modal image segmentation in the inference stage, a synthesis-segmentation task complementation network is constructed to mutually facilitate cross-modal image synthesis and segmentation since the same content feature can be used to perform the image segmentation task and image synthesis task. To maintain the consistency of the target organ with varied shapes, a curvature consistency loss is proposed to align the segmentation predictions of the original image and the cross-modal synthesized image. To segment the small lesions or substructures, a regression-segmentation task complementation network is constructed to utilize the auxiliary feature of the target organ. RESULTS: Comprehensive experiments have been performed with an in-house dataset and a publicly available dataset. The experimental results have demonstrated the superiority of our framework over state-of-the-art methods. CONCLUSION: The proposed method can fuse dual-modal CT/MR images in the training stage and only needs single-modal CT/MR images in the inference stage. SIGNIFICANCE: The proposed method can be used in routine clinical occasions when only single-modal CT/MR image is available for a patient.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of the Jiangsu Higher Education Institutions of China
- China Postdoctoral Science Foundation
- Priority Academic Program Development of Jiangsu Higher Education Institutions
- Natural Science Foundation of Shanghai Science and Technology Innovation Action Plan
- Clinical Research Plan of Shanghai Hospital Development Center
Zitieren
APA
Xiang, D., Peng, T., Bian, Y., Chen, L., Zeng, J., Shi, F., Zhu, W., & Chen, X. (2025). Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation. IEEE Transactions on Biomedical Engineering. https://doi.org/10.1109/tbme.2024.3467216
Vancouver
Xiang D, Peng T, Bian Y, Chen L, Zeng J, Shi F, et al. Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation. IEEE Transactions on Biomedical Engineering. 2025. doi:10.1109/tbme.2024.3467216
BibTeX
@article{Xiang2025,
author = {Xiang, Dehui and Peng, Tao and Bian, Yun and Chen, Lang and Zeng, Jianbin and Shi, Fei and Zhu, Weifang and Chen, Xinjian},
title = {Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation},
journal = {IEEE Transactions on Biomedical Engineering},
year = {2025},
doi = {10.1109/tbme.2024.3467216}
}
EUVIMED