SQ-LoRA: Memory-Efficient Language Model Compression Through Stable-Rank-Guided Quantization for Edge Computing Applications
Applied Sciences · 21.02.2026 · 16 (4) · 2113
DOI: 10.3390/app16042113 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 21.02.2026. Verfasst von Seda Bayat Toksöz und 1 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Scientific and Technological Research Council of Türkiye.
Abstract (Originalsprache)
The deployment of transformer-based language models on resource-constrained edge devices presents fundamental challenges in computational efficiency and memory utilization. We introduce SQ-LoRA (Stable-rank Quantized Low-Rank Adaptation), a theoretically grounded compression framework that achieves unprecedented efficiency through the synergistic integration of adaptive low-rank decomposition, hardware-accelerated structured sparsity, and intelligent hybrid quantization. Our primary contribution establishes the first rigorous mathematical connection between the matrix stable rank and optimal LoRA rank selection, formalized in Theorem I, which provides bounded approximation guarantees. SQ-LoRA implements: (1) adaptive rank allocation via stable-rank analysis to automatically determine layer-wise compression ratios; (2) 4:8 structured sparsity patterns, enabling 2× hardware acceleration on modern edge processors; and (3) a three-tier quantization scheme that combines 4-bit NormalFloat storage with selective 3-bit/8-bit precision to preserve outliers. A comprehensive evaluation on four diverse natural language processing (NLP) benchmarks demonstrates that SQ-LoRA achieves a 320 MB memory footprint (96.7% reduction) and a 10 ms inference latency (91.7% improvement), and maintains 82.0% average accuracy (within 0.15% of the full model). Statistical significance testing (p < 0.001) confirms its superiority over state-of-the-art methods. This framework enables the deployment of sophisticated language models on devices with 2 GB of RAM, advancing practical edge-AI applications.
Förderung
- Scientific and Technological Research Council of Türkiye
Zitieren
APA
Toksöz, S. B., & Işik, G. (2026). SQ-LoRA: Memory-Efficient Language Model Compression Through Stable-Rank-Guided Quantization for Edge Computing Applications. Applied Sciences, 16(4), 2113. https://doi.org/10.3390/app16042113
Vancouver
Toksöz SB, Işik G. SQ-LoRA: Memory-Efficient Language Model Compression Through Stable-Rank-Guided Quantization for Edge Computing Applications. Applied Sciences. 2026;16(4):2113. doi:10.3390/app16042113
BibTeX
@article{Toksz2026,
author = {Toksöz, Seda Bayat and Işik, Gültekin},
title = {SQ-LoRA: Memory-Efficient Language Model Compression Through Stable-Rank-Guided Quantization for Edge Computing Applications},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {4},
pages = {2113},
doi = {10.3390/app16042113}
}
EUVIMED