Prototype Memory-Based Neighboring Feature Fusion Network for Image Manipulation Localization
IEEE Transactions on Circuits and Systems for Video Technology · 2026-08 · 36 (8) · 12517-12530
DOI: 10.1109/tcsvt.2026.3679746 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-08. Verfasst von Songlin Li und 6 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: Central Government Guides Local Science and Technology Development Fund Projects, National Natural Science Foundation of China, Xinjiang University Outstanding Graduate Student Innovation Project.
Abstract (Originalsprache)
Image manipulation localization (IML) aims to segment manipulated regions in suspicious images. However, most existing methods rely solely on intrinsic features extracted from the input image and passively model local or global inconsistencies, making it difficult to accurately delineate manipulated regions with ambiguous boundaries. To address these challenges, we propose a prototype memory-based neighboring feature fusion network (PNF-Net), which is inspired by a biological memory mechanism. PNF-Net simulates selective preference by learning manipulation-trace prototypes as memory priors, thereby guiding representation learning toward consistent and discriminative manipulation cues. Specifically, we propose a memory-guided localization module (MLM) that models the consistencies and anomalies between manipulated regions and the background as memory priors, enabling precise localization. We then propose a neighboring feature interaction module (NFIM) that preserves fine-grained details from neighboring shallow features, enhances global semantics from neighboring deep features, and effectively fuses them. Finally, a verification fusion module (VFM) is designed to enrich contextual semantics and improve the completeness and accuracy of localization results. Extensive experiments on multiple benchmark datasets show that our PNF-Net outperforms most state-of-the-art IML models. Our code is available on https://github.com/vpsg-research/PNF-Net
Förderung
- Central Government Guides Local Science and Technology Development Fund Projects
- National Natural Science Foundation of China
- Xinjiang University Outstanding Graduate Student Innovation Project
Zitieren
APA
Li, S., Guo, Z., Miao, C., Yang, W., Wang, L., Yang, G., & Liao, X. (2026). Prototype Memory-Based Neighboring Feature Fusion Network for Image Manipulation Localization. IEEE Transactions on Circuits and Systems for Video Technology, 36(8), 12517-12530. https://doi.org/10.1109/tcsvt.2026.3679746
Vancouver
Li S, Guo Z, Miao C, Yang W, Wang L, Yang G, et al. Prototype Memory-Based Neighboring Feature Fusion Network for Image Manipulation Localization. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(8):12517-12530. doi:10.1109/tcsvt.2026.3679746
BibTeX
@article{Li2026,
author = {Li, Songlin and Guo, Zhiqing and Miao, Changtao and Yang, Wenzhong and Wang, Liejun and Yang, Gaobo and Liao, Xin},
title = {Prototype Memory-Based Neighboring Feature Fusion Network for Image Manipulation Localization},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2026},
volume = {36},
number = {8},
pages = {12517--12530},
doi = {10.1109/tcsvt.2026.3679746}
}
EUVIMED