Noise-Induced Cross-Modal Information Interaction and Dual-Prompt Learning for Medical Image Segmentation
IEEE Transactions on Image Processing · 2026
DOI: 10.1109/tip.2026.3723239 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Chao Huang und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted. Die Arbeit nennt 66 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shenzhen Science and Technology Program, Shenzhen General Research Project.
Abstract (Originalsprache)
Accurate medical image segmentation plays a vital role in clinical diagnostics by facilitating the precise delineation of anatomical structures and pathological regions. However, the performance of existing segmentation methods is often constrained by the scarcity of high-quality annotated datasets, as manual labeling is both labor-intensive and reliant on domain-specific expertise. To address this limitation without requiring additional annotations, we propose a novel multimodal segmentation framework that leverages medical text annotations as an auxiliary modality to complement visual information. In particular, our approach introduces a learnable encoding strategy for joint distribution modeling of image and text, which enables discriminative fusion and effectively suppresses cross-modal redundancy. Moreover, we innovatively design a frequency-domain prompt encoder based on the discrete wavelet transform (DWT) to capture multi-frequency features, thereby significantly enhancing the model's ability to delineate fine-grained boundaries. Overall, our framework integrates cross-attention for effective cross-modal interaction, employs joint distribution modeling to enable discriminative and redundancy-reduced multimodal fusion, and incorporates auxiliary supervision to strengthen the learning of task-relevant features. Extensive experiments on nine public datasets across three clinical tasks-including cell, lung infection, and polyp segmentation-demonstrate that our method achieves competitive segmentation performance while maintaining favorable computational efficiency. Comprehensive ablation studies and feature distribution visualizations further validate the effectiveness and robustness of our proposed components. The code will be made publicly available at https://github.com/chenpeng052/MDFP.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Shenzhen Science and Technology Program
- Shenzhen General Research Project
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Huang, C., Chen, P., Wen, J., Wang, W., Shen, L., Ren, W., Cao, X., & Liu, C. (2026). Noise-Induced Cross-Modal Information Interaction and Dual-Prompt Learning for Medical Image Segmentation. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2026.3723239
Vancouver
Huang C, Chen P, Wen J, Wang W, Shen L, Ren W, et al. Noise-Induced Cross-Modal Information Interaction and Dual-Prompt Learning for Medical Image Segmentation. IEEE Transactions on Image Processing. 2026. doi:10.1109/tip.2026.3723239
BibTeX
@article{Huang2026,
author = {Huang, Chao and Chen, Peng and Wen, Jie and Wang, Wei and Shen, Li and Ren, Wenqi and Cao, Xiaochun and Liu, Chengliang},
title = {Noise-Induced Cross-Modal Information Interaction and Dual-Prompt Learning for Medical Image Segmentation},
journal = {IEEE Transactions on Image Processing},
year = {2026},
doi = {10.1109/tip.2026.3723239}
}
EUVIMED