EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Computational Model Enabling Continuous Differentiability in Neural Network Quantization

Yu Yang, Zhong Ma, Yuejiao Wang, Lu Wei, Chaojie Yang

Applied Sciences · 25.05.2026 · 16 (11) · 5281

DOI: 10.3390/app16115281 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 25.05.2026. Verfasst von Yu Yang und 4 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Quantization reduces the precision of neural network parameters to accelerate inference and lower power consumption, but it often causes noticeable accuracy degradation. We propose a differentiable quantization framework that replaces the non-differentiable rounding operation with a continuous surrogate function. During QAT, gradients are backpropagated through the proposed surrogate rather than being estimated by the STE, enabling gradient-based optimization of model weights, quantization parameters, and layer-wise bit-width configurations. Experiments on CIFAR-10 show that our method achieves higher accuracy than several representative quantization approximation methods under different bit-width settings. On embedded platforms, it improves post-quantization accuracy by up to 3.66 percentage points over industrial quantization frameworks such as TensorRT and Huawei AMCT on detection and segmentation tasks, and outperforms representative bit-width allocation methods by up to 7.49 percentage points. These results demonstrate the effectiveness of the proposed method for improving the accuracy of quantized neural networks on resource-constrained devices.

Zitieren

APA

Yang, Y., Ma, Z., Wang, Y., Wei, L., & Yang, C. (2026). A Novel Computational Model Enabling Continuous Differentiability in Neural Network Quantization. Applied Sciences, 16(11), 5281. https://doi.org/10.3390/app16115281

Vancouver

Yang Y, Ma Z, Wang Y, Wei L, Yang C. A Novel Computational Model Enabling Continuous Differentiability in Neural Network Quantization. Applied Sciences. 2026;16(11):5281. doi:10.3390/app16115281

BibTeX
@article{Yang2026,
  author = {Yang, Yu and Ma, Zhong and Wang, Yuejiao and Wei, Lu and Yang, Chaojie},
  title = {A Novel Computational Model Enabling Continuous Differentiability in Neural Network Quantization},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {11},
  pages = {5281},
  doi = {10.3390/app16115281}
}
Kostenlos starten →