EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Toward Robust Arabic AI-Generated Text Detection: Tackling Diacritics Challenges

Hamed Alshammari, Khaled Elleithy

Information · 19.07.2024 · 15 (7) · 419

DOI: 10.3390/info15070419 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 19.07.2024. Verfasst von Hamed Alshammari und 1 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Current AI detection systems often struggle to distinguish between Arabic human-written text (HWT) and AI-generated text (AIGT) due to the small marks present above and below the Arabic text called diacritics. This study introduces robust Arabic text detection models using Transformer-based pre-trained models, specifically AraELECTRA, AraBERT, XLM-R, and mBERT. Our primary goal is to detect AIGTs in essays and overcome the challenges posed by the diacritics that usually appear in Arabic religious texts. We created several novel datasets with diacritized and non-diacritized texts comprising up to 9666 HWT and AIGT training examples. We aimed to assess the robustness and effectiveness of the detection models on out-of-domain (OOD) datasets to assess their generalizability. Our detection models trained on diacritized examples achieved up to 98.4% accuracy compared to GPTZero’s 62.7% on the AIRABIC benchmark dataset. Our experiments reveal that, while including diacritics in training enhances the recognition of the diacritized HWTs, duplicating examples with and without diacritics is inefficient despite the high accuracy achieved. Applying a dediacritization filter during evaluation significantly improved model performance, achieving optimal performance compared to both GPTZero and the detection models trained on diacritized examples but evaluated without dediacritization. Although our focus was on Arabic due to its writing challenges, our detector architecture is adaptable to any language.

Zitieren

APA

Alshammari, H., & Elleithy, K. (2024). Toward Robust Arabic AI-Generated Text Detection: Tackling Diacritics Challenges. Information, 15(7), 419. https://doi.org/10.3390/info15070419

Vancouver

Alshammari H, Elleithy K. Toward Robust Arabic AI-Generated Text Detection: Tackling Diacritics Challenges. Information. 2024;15(7):419. doi:10.3390/info15070419

BibTeX
@article{Alshammari2024,
  author = {Alshammari, Hamed and Elleithy, Khaled},
  title = {Toward Robust Arabic AI-Generated Text Detection: Tackling Diacritics Challenges},
  journal = {Information},
  year = {2024},
  volume = {15},
  number = {7},
  pages = {419},
  doi = {10.3390/info15070419}
}
Kostenlos starten →