EUVIMEDUpptäck EUVIMED
Open access · CC BY 4.0

An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems

Hashmath Shaik, Gnaneswar Villuri, Alex Doboli

Machine Learning and Knowledge Extraction · 2025-11-01 · 7 (4) · 134

DOI: 10.3390/make7040134 ↗

At a glance

Journal article in Machine Learning and Knowledge Extraction, published online on 2025-11-01. Written by Hashmath Shaik and 2 co-authors. Cited 3 times so far (Crossref); 166 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiska uppgifterCiteRelated studies

Abstract (original language)

Large Language Models (LLMs) offer new opportunities to devise automated implementation generation methods that can tackle problem solving beyond traditional methods, which usually require algorithmic specifications and use only static domain knowledge. LLMs can support devising new methods to support activities in tackling open-ended problems, like problem framing, exploring possible solving approaches, feature elaboration and combination, advanced implementation assessment, and handling unexpected situations. This paper presents a detailed overview of the current work on LLMs, including model prompting, retrieval-augmented generation (RAG), and reinforcement learning. It then proposes a novel, LLM-based Cognitive Architecture (CA) to generate programming code starting from verbal discussions in natural language, a particular kind of problem-solving activity. The CA uses four strategies, three top-down and one bottom-up, to elaborate, adaptively process, memorize, and learn. Experiments are devised to study the CA performance, e.g., convergence rate, semantic fidelity, and code correctness.

Cite

APA

Shaik, H., Villuri, G., & Doboli, A. (2025). An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems. Machine Learning and Knowledge Extraction, 7(4), 134. https://doi.org/10.3390/make7040134

Vancouver

Shaik H, Villuri G, Doboli A. An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems. Machine Learning and Knowledge Extraction. 2025;7(4):134. doi:10.3390/make7040134

BibTeX
@article{Shaik2025,
  author = {Shaik, Hashmath and Villuri, Gnaneswar and Doboli, Alex},
  title = {An Overview of Large Language Models and a Novel, Large Language Model-Based Cognitive Architecture for Solving Open-Ended Problems},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2025},
  volume = {7},
  number = {4},
  pages = {134},
  doi = {10.3390/make7040134}
}
Start for free →