EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large Language Models Estimate Fine‐Grained Human Color–Concept Associations

Kushin Mukherjee, Ankit Mohapatra, Timothy T Rogers, Karen B Schloss

Cognitive Science · 2026

DOI: 10.1111/cogs.70219 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Science, 2026. Verfasst von Kushin Mukherjee und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, Stanford University. Hauptthemen laut MEDLINE: Color Perception, Concept Formation, Language, Large Language Models. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 94 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

People reliably associate the meanings of both abstract and concrete words with colors distributed over color space, a phenomenon that influences aspects of visual cognition ranging from object recognition to interpreting information visualizations. Prior research has hypothesized that color–concept associations arise from the cross‐modal statistical structure of experience, but it remains unclear whether natural environments contain such structure or whether learning systems can discover it without strong prior constraints. To address these questions, we investigated whether GPT‐4, a multimodal large language model, can estimate color–concept association ratings that approximate those made by people. We tested 71 colors spanning perceptual color space and a variety of concepts varying in abstractness. GPT‐4 ratings correlated strongly with human ratings across a range of prompting strategies, outperforming prior state‐of‐the‐art methods for automatically estimating color–concept associations from images. In an empirical study assessing people's ability to interpret the meanings of colors in information visualizations, palettes generated from GPT‐4's rating data were not only interpretable but, in some cases, more effective than those based on human ratings. Taken together, our results suggest that high‐order covariance between language and perception, present in web‐scale data, provide sufficient information to learn color–concept associations without initial constraints, and that machine‐derived associations can support the optimization of information visualizations for visual communication.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Color PerceptionConcept FormationLanguageLarge Language ModelsFemaleHumansColorGenerative Artificial Intelligence

Stichwörter der Autor:innen

Color semanticsColor‐concept associationsVision‐language models

Autor:innen und Institutionen

  • Department of Psychology, Stanford University.
  • Wisconsin Institute for Discovery, University of Wisconsin-Madison.
  • Department of Computer Science, University of Wisconsin-Madison.
  • Department of Psychology, University of Wisconsin-Madison.

Förderung

  • National Science Foundation

Zitieren

APA

Mukherjee, K., Mohapatra, A., Rogers, T. T., & Schloss, K. B. (2026). Large Language Models Estimate Fine‐Grained Human Color–Concept Associations. Cognitive Science. https://doi.org/10.1111/cogs.70219

Vancouver

Mukherjee K, Mohapatra A, Rogers TT, Schloss KB. Large Language Models Estimate Fine‐Grained Human Color–Concept Associations. Cognitive Science. 2026. doi:10.1111/cogs.70219

BibTeX
@article{Mukherjee2026,
  author = {Mukherjee, Kushin and Mohapatra, Ankit and Rogers, Timothy T and Schloss, Karen B},
  title = {Large Language Models Estimate Fine‐Grained Human Color–Concept Associations},
  journal = {Cognitive Science},
  year = {2026},
  doi = {10.1111/cogs.70219}
}
Kostenlos starten →