EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fair-GPTQ: Bias-Aware Quantization for Large Language Models

Irina Proskurina, Guillaume Metzler, Julien Velcin

Transactions of the Association for Computational Linguistics · 13.10.2026 · 14 · 2574-2602

DOI: 10.1162/tacl.a.816 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 13.10.2026. Verfasst von Irina Proskurina und 2 weiteren Autor:innen. Die Arbeit nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The high memory demands of generative language models have drawn attention to quantization, which reduces memory usage by mapping model weights to lower-precision integers. However, recent empirical studies show that, while efficient, quantization can increase the likelihood of generating biased outputs and degrade performance on fairness benchmarks. In this work, we draw new links between quantization and model fairness by adding explicit group-fairness constraints to the quantization objective and introduce Fair-GPTQ, the first quantization method explicitly designed to reduce unfairness in large language models. The added constraints guide the learning of the rounding operation toward less-biased text generation for protected groups. Specifically, we focus on stereotype generation involving occupational bias and discriminatory language spanning gender, race, and religion. Fair-GPTQ has minimal impact on performance, preserving at least 90% of baseline accuracy on zero-shot benchmarks, reduces unfairness relative to a half-precision model, and retains the memory and speed benefits of 4-bit quantization.

Zitieren

APA

Proskurina, I., Metzler, G., & Velcin, J. (2026). Fair-GPTQ: Bias-Aware Quantization for Large Language Models. Transactions of the Association for Computational Linguistics, 14, 2574-2602. https://doi.org/10.1162/tacl.a.816

Vancouver

Proskurina I, Metzler G, Velcin J. Fair-GPTQ: Bias-Aware Quantization for Large Language Models. Transactions of the Association for Computational Linguistics. 2026;14:2574-2602. doi:10.1162/tacl.a.816

BibTeX
@article{Proskurina2026,
  author = {Proskurina, Irina and Metzler, Guillaume and Velcin, Julien},
  title = {Fair-GPTQ: Bias-Aware Quantization for Large Language Models},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2026},
  volume = {14},
  pages = {2574--2602},
  doi = {10.1162/tacl.a.816}
}
Kostenlos starten →