EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Using transformer-based models for Vietnamese language detection

Son Tran iD, Phuoc Tran iD

PLOS One · 2026

DOI: 10.1371/journal.pone.0342898 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Son Tran und 1 weiteren Autor:innen. Beteiligte Einrichtung: Natural Language Processing and Knowledge Discovery Research Group, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vi…. Hauptthemen laut MEDLINE: Natural Language Processing, Language. Die Arbeit nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper introduces a solution to the problem of detecting whether a sequence of text is Vietnamese based on its orthography and contextual features. For those unfamiliar with the language, it is known that understanding the meaning of certain texts can be challenging, since Vietnamese is a complex language that uses Latin characters with diacritics, and many of its words rely heavily on accent marks for semantic distinction. In this paper, we provide insight into how these characteristics influence Transformer-based natural language processing models and propose an approach to address this issue. Transformer-based models are selected due to their superior performance compared to earlier architectures such as RNNs and LSTMs, as well as their widespread application in state-of-the-art NLP systems (GPT, BERT, T5). We examine the specific challenges posed by Vietnamese orthography and word formation, and propose a solution that enhances the model’s ability to distinguish Vietnamese text. Our approach is evaluated on a benchmark dataset, demonstrating high accuracy and robustness in Vietnamese text detection, outperforming conventional methods. The results confirm that Transformer-based models can effectively learn orthographic and contextual patterns in Vietnamese, contributing to improved language identification and multilingual NLP processing.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingLanguageVietnamHumansSemanticsLarge Language Models

Autor:innen und Institutionen

  • Natural Language Processing and Knowledge Discovery Research Group, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vietnam.

ORCID-Profile: Son Tran, Phuoc Tran

Zitieren

APA

Tran, S., & Tran, P. (2026). Using transformer-based models for Vietnamese language detection. PLOS One. https://doi.org/10.1371/journal.pone.0342898

Vancouver

Tran S, Tran P. Using transformer-based models for Vietnamese language detection. PLOS One. 2026. doi:10.1371/journal.pone.0342898

BibTeX
@article{Tran2026,
  author = {Tran, Son and Tran, Phuoc},
  title = {Using transformer-based models for Vietnamese language detection},
  journal = {PLOS One},
  year = {2026},
  doi = {10.1371/journal.pone.0342898}
}
Kostenlos starten →