EUVIMEDEUVIMED entdecken
Crossref

EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing

Qihua Feng, Peiya Li, Zhixun Lu, Chaozhuo Li, Zefan Wang, Zhiquan Liu, Chunhui Duan, Feiran Huang, Jian Weng, Philip S. Yu

IEEE Transactions on Circuits and Systems for Video Technology · 2024-08 · 34 (8) · 7467-7483

DOI: 10.1109/tcsvt.2024.3370668 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-08. Verfasst von Qihua Feng und 9 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 87 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Image retrieval systems help users to browse and search among extensive images in real time. With the rise of cloud computing, retrieval tasks are usually outsourced to cloud servers. However, the cloud scenario brings a daunting challenge of privacy protection as cloud servers cannot be fully trusted. To this end, image-encryption-based privacy-preserving image retrieval (PPIR) schemes have been developed, which first extract features from cipher-images, and then build retrieval models based on these features. Yet, most existing PPIR approaches extract shallow features and design trivial unsupervised retrieval models, resulting in insufficient expressiveness for the cipher-images. In this paper, we propose a novel paradigm named Encrypted Vision Transformer (EViT), which advances the discriminative representations capability of cipher-images. First, to capture comprehensive ruled information, we extract multi-level local length sequence and global Huffman-Code frequency features from the cipher-images which are encrypted by permutation encryption, sign encryption, and stream cipher during the JPEG compression process. Second, we design the modified self-supervised Vision Transformer with Huffman-embedding and propose two robust data augmentations on cipher-images to improve representation power of the retrieval model. Moreover, our proposal can be easily adapted to unsupervised or supervised settings. Extensive experiments reveal that EViT achieves both excellent encryption and retrieval performance, outperforming current schemes in terms of retrieval accuracy by large margins while protecting image privacy effectively. Code is publicly available at https://github.com/onlinehuazai/EViT.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Basic and Applied Basic Research Foundation of Guangdong Province

Zitieren

APA

Feng, Q., Li, P., Lu, Z., Li, C., Wang, Z., Liu, Z., Duan, C., Huang, F., Weng, J., & Yu, P. S. (2024). EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing. IEEE Transactions on Circuits and Systems for Video Technology, 34(8), 7467-7483. https://doi.org/10.1109/tcsvt.2024.3370668

Vancouver

Feng Q, Li P, Lu Z, Li C, Wang Z, Liu Z, et al. EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(8):7467-7483. doi:10.1109/tcsvt.2024.3370668

BibTeX
@article{Feng2024,
  author = {Feng, Qihua and Li, Peiya and Lu, Zhixun and Li, Chaozhuo and Wang, Zefan and Liu, Zhiquan and Duan, Chunhui and Huang, Feiran and Weng, Jian and Yu, Philip S.},
  title = {EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {8},
  pages = {7467--7483},
  doi = {10.1109/tcsvt.2024.3370668}
}
Kostenlos starten →