Proactive Disentangled Modeling of Trigger–Object Pairings for Backdoor Defense
Computers, Materials & Continua · 2025 · 85 (1) · 1001-1018
DOI: 10.32604/cmc.2025.068201 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, Materials & Continua, 2025. Verfasst von Kyle Stein und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 55 Literaturangaben.
Abstract (Originalsprache)
Deep neural networks (DNNs) and generative AI (GenAI) are increasingly vulnerable to backdoor attacks, where adversaries embed triggers into inputs to cause models to misclassify or misinterpret target labels. Beyond traditional single-trigger scenarios, attackers may inject multiple triggers across various object classes, forming unseen backdoor-object configurations that evade standard detection pipelines. In this paper, we introduce DBOM (Disentangled Backdoor-Object Modeling), a proactive framework that leverages structured disentanglement to identify and neutralize both seen and unseen backdoor threats at the dataset level. Specifically, DBOM factorizes input image representations by modeling triggers and objects as independent primitives in the embedding space through the use of Vision-Language Models (VLMs). By leveraging the frozen, pre-trained encoders of VLMs, our approach decomposes the latent representations into distinct components through a learnable visual prompt repository and prompt prefix tuning, ensuring that the relationships between triggers and objects are explicitly captured. To separate trigger and object representations in the visual prompt repository, we introduce the trigger-object separation and diversity losses that aids in disentangling trigger and object visual features. Next, by aligning image features with feature decomposition and fusion, as well as learned contextual prompt tokens in a shared multimodal space, DBOM enables zero-shot generalization to novel trigger-object pairings that were unseen during training, thereby offering deeper insights into adversarial attack patterns. Experimental results on CIFAR-10 and GTSRB demonstrate that DBOM robustly detects poisoned images prior to downstream training, significantly enhancing the security of DNN training pipelines.
Zitieren
APA
Stein, K., Mahyari, A. A., III, G. F., & El-Sheikh, E. (2025). Proactive Disentangled Modeling of Trigger–Object Pairings for Backdoor Defense. Computers, Materials & Continua, 85(1), 1001-1018. https://doi.org/10.32604/cmc.2025.068201
Vancouver
Stein K, Mahyari AA, III GF, El-Sheikh E. Proactive Disentangled Modeling of Trigger–Object Pairings for Backdoor Defense. Computers, Materials & Continua. 2025;85(1):1001-1018. doi:10.32604/cmc.2025.068201
BibTeX
@article{Stein2025,
author = {Stein, Kyle and Mahyari, Andrew A. and III, Guillermo Francia and El-Sheikh, Eman},
title = {Proactive Disentangled Modeling of Trigger–Object Pairings for Backdoor Defense},
journal = {Computers, Materials & Continua},
year = {2025},
volume = {85},
number = {1},
pages = {1001--1018},
doi = {10.32604/cmc.2025.068201}
}
EUVIMED