A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations
ACM Computing Surveys · 31.07.2023 · 55 (6) · 1-40
DOI: 10.1145/3538531 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 07.12.2022. Verfasst von Denis Kleyko und 3 weiteren Autor:innen. Die Arbeit wurde bisher 127-mal zitiert (Crossref) und nennt 198 Literaturangaben. Gefördert von: European Union’s Horizon 2020 Programme, AFOSR, Intel’s THWAI program.
Abstract (Originalsprache)
This two-part comprehensive survey is devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computational models that use high-dimensional distributed representations and rely on the algebraic properties of their key operations to incorporate the advantages of structured symbolic representations and distributed vector representations. Notable models in the HDC/VSA family are Tensor Product Representations, Holographic Reduced Representations, Multiply-Add-Permute, Binary Spatter Codes, and Sparse Binary Distributed Representations but there are other models too. HDC/VSA is a highly interdisciplinary field with connections to computer science, electrical engineering, artificial intelligence, mathematics, and cognitive science. This fact makes it challenging to create a thorough overview of the field. However, due to a surge of new researchers joining the field in recent years, the necessity for a comprehensive survey of the field has become extremely important. Therefore, amongst other aspects of the field, this Part I surveys important aspects such as: known computational models of HDC/VSA and transformations of various input data types to high-dimensional distributed representations. Part II of this survey [ 84 ] is devoted to applications, cognitive computing and architectures, as well as directions for future work. The survey is written to be useful for both newcomers and practitioners.
Förderung
- European Union’s Horizon 2020 Programme
- AFOSR
- Intel’s THWAI program
- National Academy of Sciences of Ukraine
- Ministry of Education and Science of Ukraine
- Swedish Foundation for Strategic Research
Zitieren
APA
Kleyko, D., Rachkovskij, D. A., Osipov, E., & Rahimi, A. (2023). A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations. ACM Computing Surveys, 55(6), 1-40. https://doi.org/10.1145/3538531
Vancouver
Kleyko D, Rachkovskij DA, Osipov E, Rahimi A. A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations. ACM Computing Surveys. 2023;55(6):1-40. doi:10.1145/3538531
BibTeX
@article{Kleyko2023,
author = {Kleyko, Denis and Rachkovskij, Dmitri A. and Osipov, Evgeny and Rahimi, Abbas},
title = {A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations},
journal = {ACM Computing Surveys},
year = {2023},
volume = {55},
number = {6},
pages = {1--40},
doi = {10.1145/3538531}
}
EUVIMED