EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evolution and Adaptation of Large Language Models for Bahasa Indonesia

Allan Desi Alexander, Siti Setiawati

Dinasti Information and Technology · 20.07.2026 · 4 (1) · 85-93

DOI: 10.38035/dit.v4i1.3623 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Dinasti Information and Technology, online erschienen am 20.07.2026. Verfasst von Allan Desi Alexander und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluates the systematic evolution and computational adaptation of pre-trained language models and Large Language Models (LLMs) for Bahasa Indonesia and its low-resource regional dialects. Initially centered on bidirectional encoder-based representations like IndoBERT, the regional natural language processing (NLP) field has transitioned toward generative sequence-to-sequence structures and massive decoder-only architectures. This paper investigates the engineering methodologies of cross-lingual vocabulary adaptation, parameter initialization heuristics, and language-adaptive pre-training strategies designed to address text overfragmentation, representational misalignment, and tokenization cost inefficiencies. Through extensive structural benchmarks, this analysis compares discriminative and generative performances across tasks including sentiment classification, extractive question answering, text style normalization, domain-specific retrieval-augmented pipelines, and entity linking. While localized generative models such as Komodo, Sailor, and the SEA-LION suite improve contextual reasoning, colloquial style transfers, and regional dialect preservation, they remain susceptible to architectural anomalies like template leakage and entity hallucination. This study provides foundational benchmarks and methodological frameworks for adapting massive language models to morphologically rich, culturally diverse, and low-resource linguistic environments.

Zitieren

APA

Alexander, A. D., & Setiawati, S. (2026). Evolution and Adaptation of Large Language Models for Bahasa Indonesia. Dinasti Information and Technology, 4(1), 85-93. https://doi.org/10.38035/dit.v4i1.3623

Vancouver

Alexander AD, Setiawati S. Evolution and Adaptation of Large Language Models for Bahasa Indonesia. Dinasti Information and Technology. 2026;4(1):85-93. doi:10.38035/dit.v4i1.3623

BibTeX
@article{Alexander2026,
  author = {Alexander, Allan Desi and Setiawati, Siti},
  title = {Evolution and Adaptation of Large Language Models for Bahasa Indonesia},
  journal = {Dinasti Information and Technology},
  year = {2026},
  volume = {4},
  number = {1},
  pages = {85--93},
  doi = {10.38035/dit.v4i1.3623}
}
Kostenlos starten →