Structured Supervision from Quantum Models: Distilling Robustness into Classical Networks
Proceedings of the AAAI Symposium Series · 18.05.2026 · 8 (1) · 503-511
DOI: 10.1609/aaaiss.v8i1.42582 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 18.05.2026. Verfasst von Syed Rameez Naqvi und 4 weiteren Autor:innen.
Abstract (Originalsprache)
Quantum machine learning offers a practical opportunity to leverage near-term quantum devices without requiring quantum inference at deployment. We propose a quantum-classical hybrid knowledge distillation framework in which a variational quantum circuit, equipped with a Quantum Fourier Transform-inspired positional encoding, acts as a soft-label teacher for a compact classical student. Rather than serving as a standalone classifier, the quantum model is used offline to generate structured probability distributions that encode global spectral information and uncertainty. These quantum-derived soft labels are distilled into a lightweight classical network using a hybrid loss that combines hard and soft supervision. Experiments on MNIST demonstrate that students trained with quantum soft labels exhibit consistent and statistically meaningful robustness improvements to Gaussian noise and in-plane rotations compared to classical distillation baselines, while maintaining strong clean accuracy and calibration. These results highlight a distinct role for NISQ-era quantum models as supervisory signal generators, enabling quantum-informed learning within fully classical deployment pipelines.
Zitieren
APA
Naqvi, S. R., Ding, Z., Qi, F., Rahman, M. M., & Peng, L. (2026). Structured Supervision from Quantum Models: Distilling Robustness into Classical Networks. Proceedings of the AAAI Symposium Series, 8(1), 503-511. https://doi.org/10.1609/aaaiss.v8i1.42582
Vancouver
Naqvi SR, Ding Z, Qi F, Rahman MM, Peng L. Structured Supervision from Quantum Models: Distilling Robustness into Classical Networks. Proceedings of the AAAI Symposium Series. 2026;8(1):503-511. doi:10.1609/aaaiss.v8i1.42582
BibTeX
@article{Naqvi2026,
author = {Naqvi, Syed Rameez and Ding, Zhengming and Qi, Fang and Rahman, Md Mostafizer and Peng, Lu},
title = {Structured Supervision from Quantum Models: Distilling Robustness into Classical Networks},
journal = {Proceedings of the AAAI Symposium Series},
year = {2026},
volume = {8},
number = {1},
pages = {503--511},
doi = {10.1609/aaaiss.v8i1.42582}
}
EUVIMED