EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Is neuro-symbolic AI meeting its promises in natural language processing? A structured review

Kyle Hamilton, Aparna Nayak, Bojan Božić, Luca Longo

Semantic Web · 04.10.2024 · 15 (4) · 1265-1306

DOI: 10.3233/sw-223228 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Semantic Web, erschienen am 04.10.2024. Verfasst von Kyle Hamilton und 3 weiteren Autor:innen. Die Arbeit wurde bisher 50-mal zitiert (Crossref) und nennt 158 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Advocates for Neuro-Symbolic Artificial Intelligence (NeSy) assert that combining deep learning with symbolic reasoning will lead to stronger AI than either paradigm on its own. As successful as deep learning has been, it is generally accepted that even our best deep learning systems are not very good at abstract reasoning. And since reasoning is inextricably linked to language, it makes intuitive sense that Natural Language Processing (NLP), would be a particularly well-suited candidate for NeSy. We conduct a structured review of studies implementing NeSy for NLP, with the aim of answering the question of whether NeSy is indeed meeting its promises: reasoning, out-of-distribution generalization, interpretability, learning and reasoning from small data, and transferability to new domains. We examine the impact of knowledge representation, such as rules and semantic networks, language structure and relational structure, and whether implicit or explicit reasoning contributes to higher promise scores. We find that systems where logic is compiled into the neural network lead to the most NeSy goals being satisfied, while other factors such as knowledge representation, or type of neural architecture do not exhibit a clear correlation with goals being met. We find many discrepancies in how reasoning is defined, specifically in relation to human level reasoning, which impact decisions about model architectures and drive conclusions which are not always consistent across studies. Hence we advocate for a more methodical approach to the application of theories of human reasoning as well as the development of appropriate benchmarks, which we hope can lead to a better understanding of progress in the field. We make our data and code available on github for further analysis.11 https://github.com/kyleiwaniec/neuro-symbolic-ai-systematic-review

Zitieren

APA

Hamilton, K., Nayak, A., Božić, B., & Longo, L. (2024). Is neuro-symbolic AI meeting its promises in natural language processing? A structured review. Semantic Web, 15(4), 1265-1306. https://doi.org/10.3233/sw-223228

Vancouver

Hamilton K, Nayak A, Božić B, Longo L. Is neuro-symbolic AI meeting its promises in natural language processing? A structured review. Semantic Web. 2024;15(4):1265-1306. doi:10.3233/sw-223228

BibTeX
@article{Hamilton2024,
  author = {Hamilton, Kyle and Nayak, Aparna and Božić, Bojan and Longo, Luca},
  title = {Is neuro-symbolic AI meeting its promises in natural language processing? A structured review},
  journal = {Semantic Web},
  year = {2024},
  volume = {15},
  number = {4},
  pages = {1265--1306},
  doi = {10.3233/sw-223228}
}
Kostenlos starten →