EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Latent Relations at Steady‐state with Associative Nets

Kevin D Shabahang iD, Hyungwook Yim, Simon J Dennis

Cognitive Science · 2024

DOI: 10.1111/cogs.13494 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Science, 2024. Verfasst von Kevin D Shabahang und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Psychological Sciences, The University of Melbourne. Hauptthemen laut MEDLINE: Semantics. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council, National Research Foundation of Korea, Ministry of Science and ICT to HY.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Models of word meaning that exploit patterns of word usage across large text corpora to capture semantic relations, like the topic model and word2vec, condense word‐by‐context co‐occurrence statistics to induce representations that organize words along semantically relevant dimensions (e.g., synonymy, antonymy, hyponymy, etc.). However, their reliance on latent representations leaves them vulnerable to interference, makes them slow learners, and commits to a dual‐systems account of episodic and semantic memory. We show how it is possible to construct the meaning of words online during retrieval to avoid these limitations. We implement a spreading activation account of word meaning in an associative net, a one‐layer highly recurrent network of associations, called a Dynamic‐Eigen‐Net, that we developed to address the limitations of earlier variants of associative nets when scaling up to deal with unstructured input domains like natural language text. We show that spreading activation using a one‐hot coded Dynamic‐Eigen‐Net outperforms the topic model and reaches similar levels of performance as word2vec when predicting human free associations and word similarity ratings. Latent Semantic Analysis vectors reached similar levels of performance when constructed by applying dimensionality reduction to the Shifted Positive Pointwise Mutual Information but showed poorer predictability for free associations when using an entropy‐based normalization. An analysis of the rate at which the Dynamic‐Eigen‐Net reaches asymptotic performance shows that it learns faster than word2vec. We argue in favor of the Dynamic‐Eigen‐Net as a fast learner, with a single‐store, that is not subject to catastrophic interference. We present it as an alternative to instance models when delegating the induction of latent relationships to process assumptions instead of assumptions about representation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SemanticsHumansLanguageAssociationNeural Networks, Computer

Stichwörter der Autor:innen

Associative netProcess modelRetrieval dynamicsSemantic memoryWords

Autor:innen und Institutionen

  • School of Psychological Sciences, The University of Melbourne.
  • Department of Cognitive Sciences, Hanyang University.

ORCID-Profile: Kevin D Shabahang

Förderung

  • Australian Research Council
  • National Research Foundation of Korea
  • Ministry of Science and ICT to HY

Zitieren

APA

Shabahang, K. D., Yim, H., & Dennis, S. J. (2024). Latent Relations at Steady‐state with Associative Nets. Cognitive Science. https://doi.org/10.1111/cogs.13494

Vancouver

Shabahang KD, Yim H, Dennis SJ. Latent Relations at Steady‐state with Associative Nets. Cognitive Science. 2024. doi:10.1111/cogs.13494

BibTeX
@article{Shabahang2024,
  author = {Shabahang, Kevin D and Yim, Hyungwook and Dennis, Simon J},
  title = {Latent Relations at Steady‐state with Associative Nets},
  journal = {Cognitive Science},
  year = {2024},
  doi = {10.1111/cogs.13494}
}
Kostenlos starten →