EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing
IEEE Transactions on Circuits and Systems for Video Technology · 2024-08 · 34 (8) · 7467-7483
DOI: 10.1109/tcsvt.2024.3370668 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-08. Verfasst von Qihua Feng und 9 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 87 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province.
Abstract (Originalsprache)
Image retrieval systems help users to browse and search among extensive images in real time. With the rise of cloud computing, retrieval tasks are usually outsourced to cloud servers. However, the cloud scenario brings a daunting challenge of privacy protection as cloud servers cannot be fully trusted. To this end, image-encryption-based privacy-preserving image retrieval (PPIR) schemes have been developed, which first extract features from cipher-images, and then build retrieval models based on these features. Yet, most existing PPIR approaches extract shallow features and design trivial unsupervised retrieval models, resulting in insufficient expressiveness for the cipher-images. In this paper, we propose a novel paradigm named Encrypted Vision Transformer (EViT), which advances the discriminative representations capability of cipher-images. First, to capture comprehensive ruled information, we extract multi-level local length sequence and global Huffman-Code frequency features from the cipher-images which are encrypted by permutation encryption, sign encryption, and stream cipher during the JPEG compression process. Second, we design the modified self-supervised Vision Transformer with Huffman-embedding and propose two robust data augmentations on cipher-images to improve representation power of the retrieval model. Moreover, our proposal can be easily adapted to unsupervised or supervised settings. Extensive experiments reveal that EViT achieves both excellent encryption and retrieval performance, outperforming current schemes in terms of retrieval accuracy by large margins while protecting image privacy effectively. Code is publicly available at https://github.com/onlinehuazai/EViT.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Feng, Q., Li, P., Lu, Z., Li, C., Wang, Z., Liu, Z., Duan, C., Huang, F., Weng, J., & Yu, P. S. (2024). EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing. IEEE Transactions on Circuits and Systems for Video Technology, 34(8), 7467-7483. https://doi.org/10.1109/tcsvt.2024.3370668
Vancouver
Feng Q, Li P, Lu Z, Li C, Wang Z, Liu Z, et al. EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(8):7467-7483. doi:10.1109/tcsvt.2024.3370668
BibTeX
@article{Feng2024,
author = {Feng, Qihua and Li, Peiya and Lu, Zhixun and Li, Chaozhuo and Wang, Zefan and Liu, Zhiquan and Duan, Chunhui and Huang, Feiran and Weng, Jian and Yu, Philip S.},
title = {EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {8},
pages = {7467--7483},
doi = {10.1109/tcsvt.2024.3370668}
}
EUVIMED