Contextual Learning Support for Low-Resource Language Large Language Models: Efficient Training Strategies for Zero-Shot and Few-Shot Learning
Pinnacle Academic Press Proceedings Series · 11.04.2026 · 10 · 344-352
DOI: 10.71222/gkj3aw70 ↗Kurz gefasst
Fachartikel in der Zeitschrift Pinnacle Academic Press Proceedings Series, online erschienen am 11.04.2026. Verfasst von Tanya Xiang. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In natural language processing tasks for low-resource languages, building high-quality large language models faces numerous challenges, including data scarcity, domain mismatch, and limited annotation resources. This paper proposes an efficient training strategy based on contextual learning, aimed at addressing the difficulties encountered by low-resource languages in zero-shot and few-shot learning scenarios. The approach leverages cross-lingual knowledge transfer from high-resource languages and systematically enhances contextual information in prompts and representations to maximize the model’s generalization ability. We explore the combination of multi-task learning and self-supervised learning to exploit heterogeneous corpora, using existing multilingual and monolingual resources for pretraining. A lightweight fine-tuning stage with a small amount of labeled data is then employed for targeted adaptation to specific downstream tasks and languages. The proposed framework is designed to be computationally efficient, reducing training cost while maintaining or improving performance. Experimental results on a range of language understanding and generation benchmarks demonstrate significant improvements in task performance across various low-resource languages under both zero-shot and few-shot conditions. Ablation studies further highlight the contribution of contextual learning components and cross-lingual transfer mechanisms. These findings provide practical guidance for developing scalable large language models for underrepresented languages and offer new ideas and methods for future research on inclusive and resource-efficient language technologies.
Zitieren
APA
Xiang, T. (2026). Contextual Learning Support for Low-Resource Language Large Language Models: Efficient Training Strategies for Zero-Shot and Few-Shot Learning. Pinnacle Academic Press Proceedings Series, 10, 344-352. https://doi.org/10.71222/gkj3aw70
Vancouver
Xiang T. Contextual Learning Support for Low-Resource Language Large Language Models: Efficient Training Strategies for Zero-Shot and Few-Shot Learning. Pinnacle Academic Press Proceedings Series. 2026;10:344-352. doi:10.71222/gkj3aw70
BibTeX
@article{Xiang2026,
author = {Xiang, Tanya},
title = {Contextual Learning Support for Low-Resource Language Large Language Models: Efficient Training Strategies for Zero-Shot and Few-Shot Learning},
journal = {Pinnacle Academic Press Proceedings Series},
year = {2026},
volume = {10},
pages = {344--352},
doi = {10.71222/gkj3aw70}
}
EUVIMED