EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Liar, Liar, LLM on Fire: Investigating Deception in Turkish Text Generation

Necva Bölücü, Zehra Yücel, Dilber Çetintaş

ACM Transactions on Asian and Low-Resource Language Information Processing · 30.06.2026 · 25 (6) · 1-21

DOI: 10.1145/3811025 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Asian and Low-Resource Language Information Processing, online erschienen am 08.06.2026. Verfasst von Necva Bölücü und 2 weiteren Autor:innen. Die Arbeit nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

‘‘Is a Large Language Model (LLM) a good liar? Can we detect its lies for Turkish?” LLMs are capable of generating deceptive or misleading information, which can be considered as “lying”. In this article, we introduce a dataset called TQuADFake , consisting of correct and incorrect sentences generated by LLMs through the Question Answering (QA) task. We evaluate the quality of the dataset using both human and LLM evaluators. We explore linguistic features that may help distinguish incorrect sentences and build a lie detection model based on these features. Our analysis shows that while linguistic features are useful for identifying differences between correct and incorrect sentences, these features alone are insufficient to fully solve the lie detection problem. We also investigate whether LLMs are aware of their own inaccuracies and compare various models’ performance on this task, including SVM, pre-trained language models (PLMs), and LLMs. This study provides a foundation for future research on misinformation detection in Turkish and highlights the challenges in building effective lie detection systems. 1

Zitieren

APA

Bölücü, N., Yücel, Z., & Çetintaş, D. (2026). Liar, Liar, LLM on Fire: Investigating Deception in Turkish Text Generation. ACM Transactions on Asian and Low-Resource Language Information Processing, 25(6), 1-21. https://doi.org/10.1145/3811025

Vancouver

Bölücü N, Yücel Z, Çetintaş D. Liar, Liar, LLM on Fire: Investigating Deception in Turkish Text Generation. ACM Transactions on Asian and Low-Resource Language Information Processing. 2026;25(6):1-21. doi:10.1145/3811025

BibTeX
@article{Blc2026,
  author = {Bölücü, Necva and Yücel, Zehra and Çetintaş, Dilber},
  title = {Liar, Liar, LLM on Fire: Investigating Deception in Turkish Text Generation},
  journal = {ACM Transactions on Asian and Low-Resource Language Information Processing},
  year = {2026},
  volume = {25},
  number = {6},
  pages = {1--21},
  doi = {10.1145/3811025}
}
Kostenlos starten →