Metrics and a Single-Pass Framework for Disentangling Feature-Level Privacy Risk in Machine Learning Models
Machine Learning and Knowledge Extraction · 28.10.2026 · 8 (11) · 358
DOI: 10.3390/make8110358 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machine Learning and Knowledge Extraction, online erschienen am 28.10.2026. Verfasst von Daniel S. Soper. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: California State University, Fullerton.
Abstract (Originalsprache)
This paper introduces a diagnostic pipeline for evaluating feature-level privacy risk in machine learning (ML) models, anchored by the Coordinate Dependency Index (CDI)—a unitless, cross-modality metric that is designed to quantify the relative degree of coordinate dependence that persists following an ML model’s compression process. Grounded in the Information Bottleneck principle, the CDI establishes an exact algebraic threshold—the Invariance Horizon at e−1≈0.37—to detect coordinate dependence across disparate data types. To facilitate direct cross-modality comparisons of the underlying leakage, we integrate Absolute Information Gain (AIG) as a complementary metric that maps these threshold exceedances into absolute bits. To operationalize this dual-metric approach, we develop the Representational Interrogator (RI), an inverse multi-task learning architecture that resolves the long-standing Audit Scalability Gap in ML privacy auditing. Experimental results across 30 trials demonstrate that the RI framework maintains strong initialization stability and achieves single-pass efficiency by collapsing traditional, sequential privacy auditing batteries into a unified training objective. Achieving speedups of up to 91× over generative adversarial batteries while maintaining strong diagnostic rank-order alignment, the framework’s robustness across deep neural networks and gradient-boosted decision trees validates the RI-CDI-AIG pipeline as a principled, architecture-independent methodology for disentangling and ranking informational vulnerabilities in ML models.
Förderung
- California State University, Fullerton
Zitieren
APA
Soper, D. S. (2026). Metrics and a Single-Pass Framework for Disentangling Feature-Level Privacy Risk in Machine Learning Models. Machine Learning and Knowledge Extraction, 8(11), 358. https://doi.org/10.3390/make8110358
Vancouver
Soper DS. Metrics and a Single-Pass Framework for Disentangling Feature-Level Privacy Risk in Machine Learning Models. Machine Learning and Knowledge Extraction. 2026;8(11):358. doi:10.3390/make8110358
BibTeX
@article{Soper2026,
author = {Soper, Daniel S.},
title = {Metrics and a Single-Pass Framework for Disentangling Feature-Level Privacy Risk in Machine Learning Models},
journal = {Machine Learning and Knowledge Extraction},
year = {2026},
volume = {8},
number = {11},
pages = {358},
doi = {10.3390/make8110358}
}
EUVIMED