EUVIMEDEUVIMED entdecken
Crossref

Attack as Defense: Proactive Adversarial Multi-Modal Learning to Evade Retrieval

Fengling Li, Tianshi Wang, Lei Zhu, Jingjing Li, Heng Tao Shen

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-06 · 47 (6) · 4717-4733

DOI: 10.1109/tpami.2025.3546334 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-06. Verfasst von Fengling Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 89 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With growing concerns about information security, protecting the privacy of user-sensitive data has become crucial. The rapid development of multi-modal retrieval technologies poses new threats, making sensitive data more vulnerable to leakage and malicious mining. To address this, we introduce a Proactive Adversarial Multi-modal Learning (PAML) approach that transforms sensitive data into adversarial counterparts, evading malicious multi-modal retrieval and ensuring privacy. Our method starts by sending queries to a knowledge-agnostic retrieval system and analyzing the results to understand the retrieval feedback mechanism. Using a U-Net-based diffusion model, we create a semantic perturbation network that subtly alters the implicit semantics of sensitive data. This, combined with multi-modal retrieved results and random noise, shifts the data's semantics towards outliers, preventing retrieval as neighbors to relevant queries. Additionally, a discriminator and pre-trained model enhance the visual realism and outlier generalization of protected data. Extensive experiments show that PAML outperforms potential baselines in data privacy protection. Ablation analysis validates each component's effectiveness, and our approach's variants are applicable to diverse retrieval systems.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Li, F., Wang, T., Zhu, L., Li, J., & Shen, H. T. (2025). Attack as Defense: Proactive Adversarial Multi-Modal Learning to Evade Retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(6), 4717-4733. https://doi.org/10.1109/tpami.2025.3546334

Vancouver

Li F, Wang T, Zhu L, Li J, Shen HT. Attack as Defense: Proactive Adversarial Multi-Modal Learning to Evade Retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(6):4717-4733. doi:10.1109/tpami.2025.3546334

BibTeX
@article{Li2025,
  author = {Li, Fengling and Wang, Tianshi and Zhu, Lei and Li, Jingjing and Shen, Heng Tao},
  title = {Attack as Defense: Proactive Adversarial Multi-Modal Learning to Evade Retrieval},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {6},
  pages = {4717--4733},
  doi = {10.1109/tpami.2025.3546334}
}
Kostenlos starten →