Detecting Sequential Deepfake Manipulation via Spectral Transformer With Pyramid Attention in Consumer IoT
IEEE Transactions on Consumer Electronics · 2025-05 · 71 (2) · 6371-6380
DOI: 10.1109/tce.2024.3414319 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-05. Verfasst von Guisheng Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 41 Literaturangaben. Gefördert von: National Natural Science Foundation of Shandong Province.
Abstract (Originalsprache)
Recently, the Consumer Internet of Things (CIoT) has brought great convenience to people. In CIoT, face image information is indispensable for payment and checking the identity of the user in the transaction. However, the misuse of deepfake face information in CIoT transactions is a growing problem. It has seriously violated the property and privacy of individuals. Moreover, with the proliferation of easily accessible facial editing applications, individuals can effortlessly manipulate facial components through sequential multi-step manipulations. To solve this issue, we propose a Spectral Transformer with a Pyramid Attention (STPA) model to detect sequence permutations in manipulated facial images. Specifically, we introduce a pyramid attention module that integrates both spatial and channel attention mechanisms to prioritize the face region over the background region. Additionally, a spectral Transformer is employed concurrently to extract global and local features to facilitate the fine-grained extraction of the face forgery region. Comprehensive experiments prove that the proposed method can enhance the detection accuracy of the sequential deepfake manipulation task through the fine-grained extraction of features in the face forgery region.
Förderung
- National Natural Science Foundation of Shandong Province
Zitieren
APA
Zhang, G., Li, Q., Gao, M., Guo, S., & Jeon, G. (2025). Detecting Sequential Deepfake Manipulation via Spectral Transformer With Pyramid Attention in Consumer IoT. IEEE Transactions on Consumer Electronics, 71(2), 6371-6380. https://doi.org/10.1109/tce.2024.3414319
Vancouver
Zhang G, Li Q, Gao M, Guo S, Jeon G. Detecting Sequential Deepfake Manipulation via Spectral Transformer With Pyramid Attention in Consumer IoT. IEEE Transactions on Consumer Electronics. 2025;71(2):6371-6380. doi:10.1109/tce.2024.3414319
BibTeX
@article{Zhang2025,
author = {Zhang, Guisheng and Li, Qilei and Gao, Mingliang and Guo, Siyou and Jeon, Gwanggil},
title = {Detecting Sequential Deepfake Manipulation via Spectral Transformer With Pyramid Attention in Consumer IoT},
journal = {IEEE Transactions on Consumer Electronics},
year = {2025},
volume = {71},
number = {2},
pages = {6371--6380},
doi = {10.1109/tce.2024.3414319}
}
EUVIMED