Intriguing Properties of Adversarial ML Attacks in the Problem Space [Extended Version]
ACM Transactions on Privacy and Security · 30.11.2025 · 28 (4) · 1-37
DOI: 10.1145/3742895 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Privacy and Security, online erschienen am 11.09.2025. Verfasst von Jacopo Cortellazzi und 5 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 86 Literaturangaben. Gefördert von: UK EPSRC Grant, Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy, IFI program of the German Academic Exchange Service.
Abstract (Originalsprache)
Recent research efforts on adversarial machine learning (ML) have investigated problem-space attacks, focusing on the generation of real evasive objects in domains where, unlike images, there is no clear inverse mapping to the feature space (e.g., software). However, the design, comparison, and real-world implications of problem-space attacks remain underexplored. This article makes three major contributions. Firstly, we propose a general formalization for adversarial ML evasion attacks in the problem-space, which includes the definition of a comprehensive set of constraints on available transformations, preserved semantics, absent artifacts, and plausibility. We shed light on the relationship between feature space and problem space, and we introduce the concept of side-effect features as the by-product of the inverse feature-mapping problem. This enables us to define and prove necessary and sufficient conditions for the existence of problem-space attacks. Secondly, building on our general formalization, we propose a novel problem-space attack on Android malware that overcomes past limitations in terms of semantics and artifacts. We have tested our approach on a dataset with 150K Android apps from 2016 and 2018 which show the practical feasibility of evading a state-of-the-art malware classifier along with its hardened version. Thirdly, we explore the effectiveness of adversarial training as a possible approach to enforce robustness against adversarial samples, evaluating its effectiveness on the considered machine learning models under different scenarios. Our results demonstrate that “adversarial-malware as a service” is a realistic threat, as we automatically generate thousands of realistic and inconspicuous adversarial applications at scale, where on average it takes only a few minutes to generate an adversarial instance.
Förderung
- UK EPSRC Grant
- Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy
- IFI program of the German Academic Exchange Service
- Vienna Science and Technology Fund (WWTF) through the BREADS project
Zitieren
APA
Cortellazzi, J., Quiring, E., Arp, D., Pendlebury, F., Pierazzi, F., & Cavallaro, L. (2025). Intriguing Properties of Adversarial ML Attacks in the Problem Space [Extended Version]. ACM Transactions on Privacy and Security, 28(4), 1-37. https://doi.org/10.1145/3742895
Vancouver
Cortellazzi J, Quiring E, Arp D, Pendlebury F, Pierazzi F, Cavallaro L. Intriguing Properties of Adversarial ML Attacks in the Problem Space [Extended Version]. ACM Transactions on Privacy and Security. 2025;28(4):1-37. doi:10.1145/3742895
BibTeX
@article{Cortellazzi2025,
author = {Cortellazzi, Jacopo and Quiring, Erwin and Arp, Daniel and Pendlebury, Feargus and Pierazzi, Fabio and Cavallaro, Lorenzo},
title = {Intriguing Properties of Adversarial ML Attacks in the Problem Space [Extended Version]},
journal = {ACM Transactions on Privacy and Security},
year = {2025},
volume = {28},
number = {4},
pages = {1--37},
doi = {10.1145/3742895}
}
EUVIMED