EUVIMEDEUVIMED entdecken
Crossref

Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation

Dehui Xiang, Tao Peng, Yun Bian, Lang Chen, Jianbin Zeng, Fei Shi, Weifang Zhu, Xinjian Chen

IEEE Transactions on Biomedical Engineering · 2025

DOI: 10.1109/tbme.2024.3467216 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2025. Verfasst von Dehui Xiang und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Tomography, X-Ray Computed, Multimodal Imaging, Machine Learning. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of the Jiangsu Higher Education Institutions of China, China Postdoctoral Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

OBJECTIVE: Multi-modal MR/CT image segmentation is an important task in disease diagnosis and treatment, but it is usually difficult to acquire aligned multi-modal images of a patient in clinical practice due to the high cost and specific allergic reactions to contrast agents. To address these issues, a task complementation framework is proposed to enable unpaired multi-modal image complementation learning in the training stage and single-modal image segmentation in the inference stage. METHOD: To fuse unpaired dual-modal images in the training stage and allow single-modal image segmentation in the inference stage, a synthesis-segmentation task complementation network is constructed to mutually facilitate cross-modal image synthesis and segmentation since the same content feature can be used to perform the image segmentation task and image synthesis task. To maintain the consistency of the target organ with varied shapes, a curvature consistency loss is proposed to align the segmentation predictions of the original image and the cross-modal synthesized image. To segment the small lesions or substructures, a regression-segmentation task complementation network is constructed to utilize the auxiliary feature of the target organ. RESULTS: Comprehensive experiments have been performed with an in-house dataset and a publicly available dataset. The experimental results have demonstrated the superiority of our framework over state-of-the-art methods. CONCLUSION: The proposed method can fuse dual-modal CT/MR images in the training stage and only needs single-modal CT/MR images in the inference stage. SIGNIFICANCE: The proposed method can be used in routine clinical occasions when only single-modal CT/MR image is available for a patient.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Magnetic Resonance ImagingTomography, X-Ray ComputedMultimodal ImagingMachine LearningImage Interpretation, Computer-AssistedHumansAlgorithms

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of the Jiangsu Higher Education Institutions of China
  • China Postdoctoral Science Foundation
  • Priority Academic Program Development of Jiangsu Higher Education Institutions
  • Natural Science Foundation of Shanghai Science and Technology Innovation Action Plan
  • Clinical Research Plan of Shanghai Hospital Development Center

Zitieren

APA

Xiang, D., Peng, T., Bian, Y., Chen, L., Zeng, J., Shi, F., Zhu, W., & Chen, X. (2025). Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation. IEEE Transactions on Biomedical Engineering. https://doi.org/10.1109/tbme.2024.3467216

Vancouver

Xiang D, Peng T, Bian Y, Chen L, Zeng J, Shi F, et al. Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation. IEEE Transactions on Biomedical Engineering. 2025. doi:10.1109/tbme.2024.3467216

BibTeX
@article{Xiang2025,
  author = {Xiang, Dehui and Peng, Tao and Bian, Yun and Chen, Lang and Zeng, Jianbin and Shi, Fei and Zhu, Weifang and Chen, Xinjian},
  title = {Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation},
  journal = {IEEE Transactions on Biomedical Engineering},
  year = {2025},
  doi = {10.1109/tbme.2024.3467216}
}
Kostenlos starten →