EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Comparison of Large Language Model with Aphasia

Takamitsu Watanabe iD, Katsuma Inoue, Yasuo Kuniyoshi, Kohei Nakajima, Kazuyuki Aihara

Advanced Science · 2025

DOI: 10.1002/advs.202414016 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Advanced Science, 2025. Verfasst von Takamitsu Watanabe und 4 weiteren Autor:innen. Beteiligte Einrichtung: International Research Centre for Neurointelligence, The University of Tokyo Institutes for Advanced Study, 7-3-1 Hongo Bunkyo-ku, Tokyo, 113-0033, J…. Hauptthemen laut MEDLINE: Aphasia, Language, Brain. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JST FOREST Program, Japan Science and Technology Corporation, Moonshot Research and Development Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) respond fluently but often inaccurately, which resembles aphasia in humans. Does this behavioral similarity indicate any resemblance in internal information processing between LLMs and aphasic humans? Here, we address this question by comparing the network dynamics between LLMs—ALBERT, GPT‐2, Llama‐3.1 and one Japanese variant of Llama—and various aphasic brains. Using energy landscape analysis, we quantify how frequently the network activity pattern is likely to move from one state to another (transition frequency) and how long it tends to dwell in each state (dwelling time). First, by investigating the frequency spectrums of these two indices for brain dynamics, we find that the degrees of the polarization of the transition frequency and dwelling time enable accurate classification of receptive aphasia, expressive aphasia and controls: receptive aphasia shows the bimodal distributions for both indices, whereas expressive aphasia exhibits the most uniform distributions. In parallel, we identify highly polarized distributions in both transition frequency and dwelling time in the network dynamics in the four LLMs. These findings indicate the similarity in internal information processing between LLMs and receptive aphasia, and the current approach can provide a novel diagnosis and classification tool for LLMs and help their performance improve.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AphasiaLanguageBrainHumansLarge Language Models

Stichwörter der Autor:innen

aphasiaenergy landscape analysislarge language model

Autor:innen und Institutionen

  • International Research Centre for Neurointelligence, The University of Tokyo Institutes for Advanced Study, 7-3-1 Hongo Bunkyo-ku, Tokyo, 113-0033, Japan.
  • Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, 113-8656, Japan.

ORCID-Profile: Takamitsu Watanabe

Förderung

  • JST FOREST Program
  • Japan Science and Technology Corporation
  • Moonshot Research and Development Program
  • Japan Society for the Promotion of Science

Zitieren

APA

Watanabe, T., Inoue, K., Kuniyoshi, Y., Nakajima, K., & Aihara, K. (2025). Comparison of Large Language Model with Aphasia. Advanced Science. https://doi.org/10.1002/advs.202414016

Vancouver

Watanabe T, Inoue K, Kuniyoshi Y, Nakajima K, Aihara K. Comparison of Large Language Model with Aphasia. Advanced Science. 2025. doi:10.1002/advs.202414016

BibTeX
@article{Watanabe2025,
  author = {Watanabe, Takamitsu and Inoue, Katsuma and Kuniyoshi, Yasuo and Nakajima, Kohei and Aihara, Kazuyuki},
  title = {Comparison of Large Language Model with Aphasia},
  journal = {Advanced Science},
  year = {2025},
  doi = {10.1002/advs.202414016}
}
Kostenlos starten →