EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Development and validation of a scale assessing perceived trustworthiness in large language models

Ala Yankouskaya, Basad Barajeeh, Areej Babiker, Sameha AlShakhsi, Yunsi Tina Ma, Chun Sing Maxwell Ho, Raian Ali

Discover Artificial Intelligence · 12.11.2026 · 6 (1)

DOI: 10.1007/s44163-026-02494-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Discover Artificial Intelligence, online erschienen am 12.11.2026. Verfasst von Ala Yankouskaya und 6 weiteren Autor:innen. Die Arbeit nennt 91 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Qatar National Library.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) are increasingly part of everyday life, yet there is no established way to measure how users evaluate their trustworthiness. This study introduces the Perceived Trustworthiness of LLMs scale (PT-LLM-8), a self-report psychometric instrument measuring users’ perceived trustworthiness of their primary LLM. PT-LLM-8 is developed from the TrustLLM framework and adapted as a human-centred measure. The PT-LLM-8 comprises eight items representing truthfulness, safety, fairness, robustness, privacy, transparency, accountability, and compliance with laws. Psychometric properties of the scale were tested with 752 LLM users in the United Kingdom (Mean age = 28.58, SD = 6.11, 50.3% males, 48.8% females). Exploratory and confirmatory factor analyses supported a one-factor structure, with high internal consistency (Cronbach’s alpha = 0.90, Composite Reliability = 0.91, strong item-total correlations (ranged between 0.62 and 0.75), and measurement invariance across gender. The total score measures overall perceived trustworthiness, while individual item responses may also be examined descriptively for information about the content represented by each item. For researchers, practitioners, and developers, the PT-LLM-8 offers a practical instrument for evaluating interventions, comparing groups and contexts, and examining whether technical safeguards are reflected in users’ perceived trustworthiness of LLM. The scale can also be applied to guide system design, support policy development, and help organisations monitor shifts in user trust toward LLMs over time, making it applicable across research, practice, and governance.

Förderung

  • Qatar National Library

Zitieren

APA

Yankouskaya, A., Barajeeh, B., Babiker, A., AlShakhsi, S., Ma, Y. T., Ho, C. S. M., & Ali, R. (2026). Development and validation of a scale assessing perceived trustworthiness in large language models. Discover Artificial Intelligence, 6(1). https://doi.org/10.1007/s44163-026-02494-4

Vancouver

Yankouskaya A, Barajeeh B, Babiker A, AlShakhsi S, Ma YT, Ho CSM, et al. Development and validation of a scale assessing perceived trustworthiness in large language models. Discover Artificial Intelligence. 2026;6(1). doi:10.1007/s44163-026-02494-4

BibTeX
@article{Yankouskaya2026,
  author = {Yankouskaya, Ala and Barajeeh, Basad and Babiker, Areej and AlShakhsi, Sameha and Ma, Yunsi Tina and Ho, Chun Sing Maxwell and Ali, Raian},
  title = {Development and validation of a scale assessing perceived trustworthiness in large language models},
  journal = {Discover Artificial Intelligence},
  year = {2026},
  volume = {6},
  number = {1},
  doi = {10.1007/s44163-026-02494-4}
}
Kostenlos starten →