EUVIMEDEUVIMED entdecken
Crossref

Balancing Efficiency and Performance: A Comparative Study of LoRA, Adapters, and Prompt Tuning

Wu Zhan, Anwar Saif

Global Social Science and Humanities Journal · 04.05.2026 · 4 (2) · 15-31

DOI: 10.59088/gi.v4i2.29 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Global Social Science and Humanities Journal, online erschienen am 04.05.2026. Verfasst von Wu Zhan und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid growth of pre-trained language models has substantially improved performance across Natural Language Processing (NLP) tasks. However, full fine-tuning remains computationally expensive because it requires updating and storing all model parameters for each downstream task. This limitation is particularly important in resource-constrained environments where access to high-performance computing infrastructure is limited. Parameter-efficient fine-tuning (PEFT) methods, including Low-Rank Adaptation (LoRA), Adapters, and Prompt Tuning, offer practical alternatives by updating only a small subset of parameters while keeping most of the pre-trained model frozen. This study presents a controlled and reproducible comparison of LoRA, Adapters, and Prompt Tuning under lightweight experimental conditions. Using SST-2 and MRPC from the GLUE benchmark with the BERT-base model, we evaluate predictive performance using accuracy and F1-score, and computational efficiency using trainable parameter ratio, training time per epoch, and peak GPU memory usage. The experimental design emphasizes accessibility by using modest hardware settings such as a single-GPU Google Colab environment. The results show that LoRA provides the strongest efficiency–performance balance, achieving performance close to full fine-tuning while substantially reducing the number of trainable parameters. Adapters demonstrate stable performance and modular flexibility but introduce moderate computational overhead. Prompt Tuning requires the fewest trainable parameters, but its performance is more sensitive to dataset size and task complexity. These findings provide practical guidance for selecting PEFT methods in resource-constrained NLP applications and highlight the importance of evaluating model adaptation strategies through both accuracy and computational cost.

Zitieren

APA

Zhan, W., & Saif, A. (2026). Balancing Efficiency and Performance: A Comparative Study of LoRA, Adapters, and Prompt Tuning. Global Social Science and Humanities Journal, 4(2), 15-31. https://doi.org/10.59088/gi.v4i2.29

Vancouver

Zhan W, Saif A. Balancing Efficiency and Performance: A Comparative Study of LoRA, Adapters, and Prompt Tuning. Global Social Science and Humanities Journal. 2026;4(2):15-31. doi:10.59088/gi.v4i2.29

BibTeX
@article{Zhan2026,
  author = {Zhan, Wu and Saif, Anwar},
  title = {Balancing Efficiency and Performance: A Comparative Study of LoRA, Adapters, and Prompt Tuning},
  journal = {Global Social Science and Humanities Journal},
  year = {2026},
  volume = {4},
  number = {2},
  pages = {15--31},
  doi = {10.59088/gi.v4i2.29}
}
Kostenlos starten →