TabEng-QLoRA: Criticality-Aware Tabular-to-Text Adaptation of Large Language Models via Saliency-Guided Quantized Low-Rank Fine-Tuning
Electronics · 19.04.2026 · 15 (8) · 1728
DOI: 10.3390/electronics15081728 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 19.04.2026. Verfasst von Seda Bayat Toksoz und 1 weiteren Autor:innen. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Scientific and Technological Research Council of Turkey, Igdir University Scientific Research Projects Coordination Unit.
Abstract (Originalsprache)
Applying large language models (LLMs) to industrial fault classification is hindered by the mismatch between tabular sensor data and text-based inputs and by the high memory cost of fine-tuning billion-parameter models on edge hardware. This paper presents TabEng-QLoRA, a framework with three contributions: (1) a criticality-aware serialization module that converts tabular sensor records into structured prompts, placing fault-critical features in semantically prominent positions; (2) a saliency-guided rank allocation mechanism that profiles layer-wise activation norms on a 500-sample calibration set and assigns adapter ranks in three tiers (r ∈ {8, 16, 32}); and (3) a feed-forward domain router for automatic adapter selection (98.1% accuracy, 0.6 ms latency). Experiments on three public benchmarks (the AI4I Predictive Maintenance Dataset) using three foundation models (LLaMA-3-8B, Mistral-7B, and Qwen2-7B) show that TabEng-QLoRA achieves a mean macro F1 of 0.908, a 10.6% gain over standard QLoRA, within 4.6–5.2 GB peak GPU memory. The framework closes 82% of the gap to full fine-tuning, while offering advantages in cross-equipment transfer learning (zero-shot macro F1: 0.743 vs. 0.341 for XGBoost retrained on 20% of target-domain data, as XGBoost cannot perform zero-shot transfer). Ablation results confirm statistically significant contributions from all three components (p < 0.001).
Förderung
- Scientific and Technological Research Council of Turkey
- Igdir University Scientific Research Projects Coordination Unit
Zitieren
APA
Toksoz, S. B., & Isik, G. (2026). TabEng-QLoRA: Criticality-Aware Tabular-to-Text Adaptation of Large Language Models via Saliency-Guided Quantized Low-Rank Fine-Tuning. Electronics, 15(8), 1728. https://doi.org/10.3390/electronics15081728
Vancouver
Toksoz SB, Isik G. TabEng-QLoRA: Criticality-Aware Tabular-to-Text Adaptation of Large Language Models via Saliency-Guided Quantized Low-Rank Fine-Tuning. Electronics. 2026;15(8):1728. doi:10.3390/electronics15081728
BibTeX
@article{Toksoz2026,
author = {Toksoz, Seda Bayat and Isik, Gultekin},
title = {TabEng-QLoRA: Criticality-Aware Tabular-to-Text Adaptation of Large Language Models via Saliency-Guided Quantized Low-Rank Fine-Tuning},
journal = {Electronics},
year = {2026},
volume = {15},
number = {8},
pages = {1728},
doi = {10.3390/electronics15081728}
}
EUVIMED