EUVIMEDEUVIMED entdecken
Crossref

UP-Net: Uncertainty-Supervised Parallel Network for Image Manipulation Localization

Dengyun Xu, Xuanjing Shen, Yingda Lyu

IEEE Transactions on Circuits and Systems for Video Technology · 2023-11 · 33 (11) · 6390-6403

DOI: 10.1109/tcsvt.2023.3269948 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-11. Verfasst von Dengyun Xu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of China Regional Joint Fund of NSFC, Anhui University Collaborative Innovation Project Subproject.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Image manipulation localization remains a hot topic due to its inherent semantic-independent nature and realistic needs. Virtually all localization studies are devoted to solving arbitrary tampering using multi-branch networks based on deep features or skip-connection structures based on full features, which may induce the loss of manipulation details or noisy interference from image semantics. This poses a challenge for existing localization methods to fully capture invisible manipulations, especially in post-processing settings and across dataset scenarios. To address the above issues, we propose an uncertainty-supervised parallel network (UP-Net) for image tampering localization that preserves more manipulation details while avoiding semantic noise. UP-Net cascades the frequency and RGB domains of the manipulated image as dual-domain embedding, instead of dual-domain parallel learning as in previous work. To learn semantic-independent manipulation features, two structurally identical parallel branches are designed to learn tampering inconsistencies from intermediate and deep coding features for gradually obtaining the initial and final localization predictions. Where attention-guided partial decoder (AGPD) integrates more precise manipulation edges and manipulation semantics without introducing additional noise by focusing on channel correlation and spatial dependence, making a significant contribution to performance. Moreover, the new concept of uncertainty-constrained loss supervision is introduced to guide UP-Net to continuously improve confidence in locating difficult pixels, which are easily misclassified due to post-processing operations. Experiments on three public manipulation datasets and two real challenge datasets show that our end-to-end UP-Net achieves significant performance in manipulation localization, generalization across datasets, and robustness compared to state-of-the-art methods.

Förderung

  • National Natural Science Foundation of China
  • National Natural Science Foundation of China Regional Joint Fund of NSFC
  • Anhui University Collaborative Innovation Project Subproject
  • Jilin University “Interdisciplinary Integration and Innovation” Young Scholars Free Exploration Project

Zitieren

APA

Xu, D., Shen, X., & Lyu, Y. (2023). UP-Net: Uncertainty-Supervised Parallel Network for Image Manipulation Localization. IEEE Transactions on Circuits and Systems for Video Technology, 33(11), 6390-6403. https://doi.org/10.1109/tcsvt.2023.3269948

Vancouver

Xu D, Shen X, Lyu Y. UP-Net: Uncertainty-Supervised Parallel Network for Image Manipulation Localization. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(11):6390-6403. doi:10.1109/tcsvt.2023.3269948

BibTeX
@article{Xu2023,
  author = {Xu, Dengyun and Shen, Xuanjing and Lyu, Yingda},
  title = {UP-Net: Uncertainty-Supervised Parallel Network for Image Manipulation Localization},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2023},
  volume = {33},
  number = {11},
  pages = {6390--6403},
  doi = {10.1109/tcsvt.2023.3269948}
}
Kostenlos starten →