Detection of Forged Images Using a Combination of Passive Methods Based on Neural Networks
Future Internet · 14.03.2024 · 16 (3) · 97
DOI: 10.3390/fi16030097 ↗Kurz gefasst
Fachartikel in der Zeitschrift Future Internet, online erschienen am 14.03.2024. Verfasst von Ancilon Leuch Alencar und 5 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundação de Amparo à Pesquisa e Inovação do Estado de Santa Catarina (Fapesc), Portuguese FCT program, Center of Technology and Systems (CTS), CAPES.
Abstract (Originalsprache)
In the current era of social media, the proliferation of images sourced from unreliable origins underscores the pressing need for robust methods to detect forged content, particularly amidst the rapid evolution of image manipulation technologies. Existing literature delineates two primary approaches to image manipulation detection: active and passive. Active techniques intervene preemptively, embedding structures into images to facilitate subsequent authenticity verification, whereas passive methods analyze image content for traces of manipulation. This study presents a novel solution to image manipulation detection by leveraging a multi-stream neural network architecture. Our approach harnesses three convolutional neural networks (CNNs) operating on distinct data streams extracted from the original image. We have developed a solution based on two passive detection methodologies. The system utilizes two separate streams to extract specific data subsets, while a third stream processes the unaltered image. Each net independently processes its respective data stream, capturing diverse facets of the image. The outputs from these nets are then fused through concatenation to ascertain whether the image has undergone manipulation, yielding a comprehensive detection framework surpassing the efficacy of its constituent methods. Our work introduces a unique dataset derived from the fusion of four publicly available datasets, featuring organically manipulated images that closely resemble real-world scenarios. This dataset offers a more authentic representation than other state-of-the-art methods that use algorithmically generated datasets based on image patches. By encompassing genuine manipulation scenarios, our dataset enhances the model’s ability to generalize across varied manipulation techniques, thereby improving its performance in real-world settings. After training, the merged approach obtained an accuracy of 89.59% in the set of validation images, significantly higher than the model trained with only unaltered images, which obtained 78.64%, and the two other models trained using images with a feature selection method applied to enhance inconsistencies that obtained 68.02% for Error-Level Analysis images and 50.70% for the method using Discrete Wavelet Transform. Moreover, our proposed approach exhibits reduced accuracy variance compared to alternative models, underscoring its stability and robustness across diverse datasets. The approach outlined in this work needs to provide information about the specific location or type of tempering, which limits its practical applications.
Förderung
- Fundação de Amparo à Pesquisa e Inovação do Estado de Santa Catarina (Fapesc)
- Portuguese FCT program, Center of Technology and Systems (CTS)
- CAPES
- CEREIA Project
Zitieren
APA
Alencar, A. L., Lopes, M. D., Fernandes, A. M. D. R., Anjos, J. C. S. D., Santana, J. F. D. P., & Leithardt, V. R. Q. (2024). Detection of Forged Images Using a Combination of Passive Methods Based on Neural Networks. Future Internet, 16(3), 97. https://doi.org/10.3390/fi16030097
Vancouver
Alencar AL, Lopes MD, Fernandes AMDR, Anjos JCSD, Santana JFDP, Leithardt VRQ. Detection of Forged Images Using a Combination of Passive Methods Based on Neural Networks. Future Internet. 2024;16(3):97. doi:10.3390/fi16030097
BibTeX
@article{Alencar2024,
author = {Alencar, Ancilon Leuch and Lopes, Marcelo Dornbusch and Fernandes, Anita Maria da Rocha and Anjos, Julio Cesar Santos dos and Santana, Juan Francisco De Paz and Leithardt, Valderi Reis Quietinho},
title = {Detection of Forged Images Using a Combination of Passive Methods Based on Neural Networks},
journal = {Future Internet},
year = {2024},
volume = {16},
number = {3},
pages = {97},
doi = {10.3390/fi16030097}
}
EUVIMED