Comparison of Large Language Model with Aphasia
Advanced Science · 2025
DOI: 10.1002/advs.202414016 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Advanced Science, 2025. Verfasst von Takamitsu Watanabe und 4 weiteren Autor:innen. Beteiligte Einrichtung: International Research Centre for Neurointelligence, The University of Tokyo Institutes for Advanced Study, 7-3-1 Hongo Bunkyo-ku, Tokyo, 113-0033, J…. Hauptthemen laut MEDLINE: Aphasia, Language, Brain. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JST FOREST Program, Japan Science and Technology Corporation, Moonshot Research and Development Program.
Abstract (Originalsprache)
Large language models (LLMs) respond fluently but often inaccurately, which resembles aphasia in humans. Does this behavioral similarity indicate any resemblance in internal information processing between LLMs and aphasic humans? Here, we address this question by comparing the network dynamics between LLMs—ALBERT, GPT‐2, Llama‐3.1 and one Japanese variant of Llama—and various aphasic brains. Using energy landscape analysis, we quantify how frequently the network activity pattern is likely to move from one state to another (transition frequency) and how long it tends to dwell in each state (dwelling time). First, by investigating the frequency spectrums of these two indices for brain dynamics, we find that the degrees of the polarization of the transition frequency and dwelling time enable accurate classification of receptive aphasia, expressive aphasia and controls: receptive aphasia shows the bimodal distributions for both indices, whereas expressive aphasia exhibits the most uniform distributions. In parallel, we identify highly polarized distributions in both transition frequency and dwelling time in the network dynamics in the four LLMs. These findings indicate the similarity in internal information processing between LLMs and receptive aphasia, and the current approach can provide a novel diagnosis and classification tool for LLMs and help their performance improve.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- International Research Centre for Neurointelligence, The University of Tokyo Institutes for Advanced Study, 7-3-1 Hongo Bunkyo-ku, Tokyo, 113-0033, Japan.
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, 113-8656, Japan.
ORCID-Profile: Takamitsu Watanabe
Förderung
- JST FOREST Program
- Japan Science and Technology Corporation
- Moonshot Research and Development Program
- Japan Society for the Promotion of Science
Zitieren
APA
Watanabe, T., Inoue, K., Kuniyoshi, Y., Nakajima, K., & Aihara, K. (2025). Comparison of Large Language Model with Aphasia. Advanced Science. https://doi.org/10.1002/advs.202414016
Vancouver
Watanabe T, Inoue K, Kuniyoshi Y, Nakajima K, Aihara K. Comparison of Large Language Model with Aphasia. Advanced Science. 2025. doi:10.1002/advs.202414016
BibTeX
@article{Watanabe2025,
author = {Watanabe, Takamitsu and Inoue, Katsuma and Kuniyoshi, Yasuo and Nakajima, Kohei and Aihara, Kazuyuki},
title = {Comparison of Large Language Model with Aphasia},
journal = {Advanced Science},
year = {2025},
doi = {10.1002/advs.202414016}
}
EUVIMED