Large Language Models: A Historical and Sociocultural Perspective
Cognitive Science · 2024
DOI: 10.1111/cogs.13430 ↗At a glance
Leserbrief in Cognitive Science, 2024. Written by Eugene Yu Ji. Institution: The Division of the Social Sciences, The University of Chicago. Major MEDLINE topics: Artificial Intelligence, Language. Cited 3 times so far (Crossref); 49 references.
Abstract (original language)
This letter explores the intricate historical and contemporary links between large language models (LLMs) and cognitive science through the lens of information theory, statistical language models, and socioanthropological linguistic theories. The emergence of LLMs highlights the enduring significance of information‐based and statistical learning theories in understanding human communication. These theories, initially proposed in the mid‐20th century, offered a visionary framework for integrating computational science, social sciences, and humanities, which nonetheless was not fully fulfilled at that time. The subsequent development of sociolinguistics and linguistic anthropology, especially since the 1970s, provided critical perspectives and empirical methods that both challenged and enriched this framework. This letter proposes that two pivotal concepts derived from this development, metapragmatic function and indexicality, offer a fruitful theoretical perspective for integrating the semantic, textual, and pragmatic, contextual dimensions of communication, an amalgamation that contemporary LLMs have yet to fully achieve. The author believes that contemporary cognitive science is at a crucial crossroads, where fostering interdisciplinary dialogues among computational linguistics, social linguistics and linguistic anthropology, and cognitive and social psychology is in particular imperative. Such collaboration is vital to bridge the computational, cognitive, and sociocultural aspects of human communication and human−AI interaction, especially in the era of large language and multimodal models and human‐centric Artificial Intelligence (AI).
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- The Division of the Social Sciences, The University of Chicago.
Cite
APA
Ji, E. Y. (2024). Large Language Models: A Historical and Sociocultural Perspective. Cognitive Science. https://doi.org/10.1111/cogs.13430
Vancouver
Ji EY. Large Language Models: A Historical and Sociocultural Perspective. Cognitive Science. 2024. doi:10.1111/cogs.13430
BibTeX
@article{Ji2024,
author = {Ji, Eugene Yu},
title = {Large Language Models: A Historical and Sociocultural Perspective},
journal = {Cognitive Science},
year = {2024},
doi = {10.1111/cogs.13430}
}
EUVIMED