EUVIMEDEUVIMED entdecken
Crossref

AI Model Compression Methods: A Distribution-Aware Residual Entropy Quantization

Nikita Sakovich, Dmitry Aksenov, Ekaterina Pleshakova, Sergey Gataullin

Computers, Materials & Continua · 2026 · 88 (2) · 1-10

DOI: 10.32604/cmc.2026.079522 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers, Materials & Continua, 2026. Verfasst von Nikita Sakovich und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

: We introduce the DARE-Q (Distribution-Aware Residual Entropy Quantization) method—a post-training quantization method for neural network weights designed to reduce bit-width with minimal degradation of model quality. Unlike traditional approaches that solely optimize the mean squared error of weight approximation, DARE-Q additionally considers the entropy of the quantization residual, allowing for control over the statistical properties of the resulting error. The method is based on channel-wise symmetric uniform quantization with scaling based on a combined loss function that includes L2 distortion and entropy regularization. The DARE-Q method is implemented as a compact DAREQuantLinear module which can be easily integrated into standard transformer pipelines without changing the inference logic or using specific kernels. The experimental analysis was conducted on the language models facebook/opt-125m and facebook/opt-350m , which contain approximately 125 and 350 million parameters. The quality of the models was assessed using the standard perplexity metric (PPL) computed on the wikitext-2-raw-v1 dataset. DARE-Q is completely data-free and does not require model retraining or calibration data, which makes it the only viable option in privacy-sensitive or confidential environments where access to the original training data is restricted—precisely the setting where methods such as GPTQ and AWQ cannot be applied. The observed increase in PPL relative to data-dependent baselines reflects this fundamental trade-off rather than a shortcoming of the approach. By leveraging per-channel scale selection and a combined loss function, DARE-Q provides a flexible trade-off between approximation accuracy and quantization error structure, creating an attractive algorithmic basis for further improvement of model compression methods.

Zitieren

APA

Sakovich, N., Aksenov, D., Pleshakova, E., & Gataullin, S. (2026). AI Model Compression Methods: A Distribution-Aware Residual Entropy Quantization. Computers, Materials & Continua, 88(2), 1-10. https://doi.org/10.32604/cmc.2026.079522

Vancouver

Sakovich N, Aksenov D, Pleshakova E, Gataullin S. AI Model Compression Methods: A Distribution-Aware Residual Entropy Quantization. Computers, Materials & Continua. 2026;88(2):1-10. doi:10.32604/cmc.2026.079522

BibTeX
@article{Sakovich2026,
  author = {Sakovich, Nikita and Aksenov, Dmitry and Pleshakova, Ekaterina and Gataullin, Sergey},
  title = {AI Model Compression Methods: A Distribution-Aware Residual Entropy Quantization},
  journal = {Computers, Materials & Continua},
  year = {2026},
  volume = {88},
  number = {2},
  pages = {1--10},
  doi = {10.32604/cmc.2026.079522}
}
Kostenlos starten →