EUVIMEDEUVIMED entdecken
Crossref

TPTAF: Task-Prior Tripartite Attention for Infrared and Visible Image Fusion

Xuyang Du, Xiwen Yao, Ankang Zang, Gong Cheng

IEEE Transactions on Image Processing · 2026 · 35 · 7857-7870

DOI: 10.1109/tip.2026.3709518 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Xuyang Du und 3 weiteren Autor:innen. Die Arbeit nennt 74 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Science and Technology Major Project of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared and visible image fusion aims to integrate complementary information to produce informative fused images for visual perception and downstream tasks. However, mainstream methods often focus on fusion reconstruction, while losses from different tasks may introduce competing optimization demands, making it difficult to balance visual quality and detection performance. To address this issue, we propose task-prior tripartite attention for infrared and visible image fusion (TPTAF), which introduces detection semantics as task-prior guidance for representation-level cross-modal interaction. TPTAF employs a decoupled encoder to organize infrared and visible features into structural and discriminative spaces, enabling cross-modal layout consistency and modality-specific detail preservation to be modeled with different roles. Meanwhile, detection semantics extracted from hybrid infrared-visible features are transformed into task priors and integrated with the decoupled representations through tripartite attention. In this interaction, structural cues stabilize the fusion layout, while task-prior guidance regulates the selection of discriminative details toward target-related evidence. For joint optimization, uncertainty-weighted learning further balances fusion and detection losses, reducing the dependence on manually assigned loss weights. Experiments on M3FD, RoadScene, AVMS, and MSRS demonstrate that TPTAF maintains stable fusion quality across different data distributions while improving the utility of fused images for downstream object detection and semantic segmentation evaluation. The code will be made available at https://github.com/Duxeno/TPTAF.

Förderung

  • National Natural Science Foundation of China
  • National Science and Technology Major Project of China

Zitieren

APA

Du, X., Yao, X., Zang, A., & Cheng, G. (2026). TPTAF: Task-Prior Tripartite Attention for Infrared and Visible Image Fusion. IEEE Transactions on Image Processing, 35, 7857-7870. https://doi.org/10.1109/tip.2026.3709518

Vancouver

Du X, Yao X, Zang A, Cheng G. TPTAF: Task-Prior Tripartite Attention for Infrared and Visible Image Fusion. IEEE Transactions on Image Processing. 2026;35:7857-7870. doi:10.1109/tip.2026.3709518

BibTeX
@article{Du2026,
  author = {Du, Xuyang and Yao, Xiwen and Zang, Ankang and Cheng, Gong},
  title = {TPTAF: Task-Prior Tripartite Attention for Infrared and Visible Image Fusion},
  journal = {IEEE Transactions on Image Processing},
  year = {2026},
  volume = {35},
  pages = {7857--7870},
  doi = {10.1109/tip.2026.3709518}
}
Kostenlos starten →