An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems
Machine Learning and Knowledge Extraction · 01.11.2025 · 7 (4) · 134
DOI: 10.3390/make7040134 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machine Learning and Knowledge Extraction, online erschienen am 01.11.2025. Verfasst von Hashmath Shaik und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 166 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Large Language Models (LLMs) offer new opportunities to devise automated implementation generation methods that can tackle problem solving beyond traditional methods, which usually require algorithmic specifications and use only static domain knowledge. LLMs can support devising new methods to support activities in tackling open-ended problems, like problem framing, exploring possible solving approaches, feature elaboration and combination, advanced implementation assessment, and handling unexpected situations. This paper presents a detailed overview of the current work on LLMs, including model prompting, retrieval-augmented generation (RAG), and reinforcement learning. It then proposes a novel, LLM-based Cognitive Architecture (CA) to generate programming code starting from verbal discussions in natural language, a particular kind of problem-solving activity. The CA uses four strategies, three top-down and one bottom-up, to elaborate, adaptively process, memorize, and learn. Experiments are devised to study the CA performance, e.g., convergence rate, semantic fidelity, and code correctness.
Zitieren
APA
Shaik, H., Villuri, G., & Doboli, A. (2025). An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems. Machine Learning and Knowledge Extraction, 7(4), 134. https://doi.org/10.3390/make7040134
Vancouver
Shaik H, Villuri G, Doboli A. An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems. Machine Learning and Knowledge Extraction. 2025;7(4):134. doi:10.3390/make7040134
BibTeX
@article{Shaik2025,
author = {Shaik, Hashmath and Villuri, Gnaneswar and Doboli, Alex},
title = {An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems},
journal = {Machine Learning and Knowledge Extraction},
year = {2025},
volume = {7},
number = {4},
pages = {134},
doi = {10.3390/make7040134}
}
EUVIMED