A conflict-aware hybrid quantum residual network for multimodal fusion
Physica Scripta · 17.11.2026
DOI: 10.1088/1402-4896/aec333 ↗Kurz gefasst
Fachartikel in der Zeitschrift Physica Scripta, online erschienen am 17.11.2026. Verfasst von Yihe Wang und 3 weiteren Autor:innen. Gefördert von: Shanghai Science and Technology Project, China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Multimodal learning aims to integrate complementary cues from different information sources to obtain more comprehensive and discriminative representations than those from a single modality. However, existing deep multimodal fusion methods often construct joint representations through feature concatenation, attention-based interactions or multi-stage fusion structures. Cross-modal conflicts are often implicitly compressed into high-dimensional features, which limits the interpretability of the fusion process. These designs may also introduce additional parameter overhead. To address these issues, this paper proposes a conflict-aware hybrid quantum residual network for multimodal fusion, namely the Hybrid Quantum Evidential Network (HQEN). HQEN extracts modality features through lightweight Dual-Modal Classical Encoders and uses an evidence-inspired shared-private decoupling mechanism to compress them into low-dimensional evidence descriptors with shared-private components. Before quantum encoding, conflict-aware phase mapping explicitly characterizes the conflict between the two modality descriptors. The resulting descriptors and conflict phase are encoded into different rotation channels of a parameterized quantum circuit. Rather than serving as an independent classifier, the quantum circuit acts as a quantum residual branch over the classical decision base, providing nonlinear correction in a low-dimensional evidence space. This design reduces the burden on a small-scale quantum circuit for complete multi-class prediction while keeping the model compact. Experimental results show that HQEN achieves competitive classification performance with a small parameter scale and a favorable accuracy--parameter trade-off. Ablation studies, conflict-stratified analysis and quantum residual output sensitivity analysis further support the roles of the evidence interface, conflict-aware phase and quantum residual branch. HQEN is trained and evaluated through classical quantum-circuit simulation, and the results support it as a compact hybrid quantum--classical modeling framework.
Förderung
- Shanghai Science and Technology Project, China
- National Natural Science Foundation of China
Zitieren
APA
Wang, Y., Zhou, R., Xu, W., & Li, Y. (2026). A conflict-aware hybrid quantum residual network for multimodal fusion. Physica Scripta. https://doi.org/10.1088/1402-4896/aec333
Vancouver
Wang Y, Zhou R, Xu W, Li Y. A conflict-aware hybrid quantum residual network for multimodal fusion. Physica Scripta. 2026. doi:10.1088/1402-4896/aec333
BibTeX
@article{Wang2026,
author = {Wang, Yihe and Zhou, Ri-Gui and Xu, Wenshan and Li, YaoChong},
title = {A conflict-aware hybrid quantum residual network for multimodal fusion},
journal = {Physica Scripta},
year = {2026},
doi = {10.1088/1402-4896/aec333}
}
EUVIMED