Using transformer-based models for Vietnamese language detection
PLOS One · 2026
DOI: 10.1371/journal.pone.0342898 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Son Tran und 1 weiteren Autor:innen. Beteiligte Einrichtung: Natural Language Processing and Knowledge Discovery Research Group, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vi…. Hauptthemen laut MEDLINE: Natural Language Processing, Language. Die Arbeit nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This paper introduces a solution to the problem of detecting whether a sequence of text is Vietnamese based on its orthography and contextual features. For those unfamiliar with the language, it is known that understanding the meaning of certain texts can be challenging, since Vietnamese is a complex language that uses Latin characters with diacritics, and many of its words rely heavily on accent marks for semantic distinction. In this paper, we provide insight into how these characteristics influence Transformer-based natural language processing models and propose an approach to address this issue. Transformer-based models are selected due to their superior performance compared to earlier architectures such as RNNs and LSTMs, as well as their widespread application in state-of-the-art NLP systems (GPT, BERT, T5). We examine the specific challenges posed by Vietnamese orthography and word formation, and propose a solution that enhances the model’s ability to distinguish Vietnamese text. Our approach is evaluated on a benchmark dataset, demonstrating high accuracy and robustness in Vietnamese text detection, outperforming conventional methods. The results confirm that Transformer-based models can effectively learn orthographic and contextual patterns in Vietnamese, contributing to improved language identification and multilingual NLP processing.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Natural Language Processing and Knowledge Discovery Research Group, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vietnam.
ORCID-Profile: Son Tran, Phuoc Tran
Zitieren
APA
Tran, S., & Tran, P. (2026). Using transformer-based models for Vietnamese language detection. PLOS One. https://doi.org/10.1371/journal.pone.0342898
Vancouver
Tran S, Tran P. Using transformer-based models for Vietnamese language detection. PLOS One. 2026. doi:10.1371/journal.pone.0342898
BibTeX
@article{Tran2026,
author = {Tran, Son and Tran, Phuoc},
title = {Using transformer-based models for Vietnamese language detection},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0342898}
}
EUVIMED