EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Comparative Assessment of LLMs for Classifying Cognitive Theory Parameters in Patient-Chatbot Interactions

Laxmi Jayannavar, T. N. R. Kumar

International Journal of Information Technology, Research and Applications · 30.06.2026 · 5 (2) · 34-41

DOI: 10.59461/ijitra.v5i2.232 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Information Technology, Research and Applications, online erschienen am 30.06.2026. Verfasst von Laxmi Jayannavar und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study presents a comparative evaluation of leading Large Language Models (LLMs) for classifying cognitive triad parameters—self-negative, world-negative, and future-negative—in patient–chatbot interactions based on Beck’s Cognitive Theory. A dataset of patient statements extracted from chatbot conversations was analyzed using GPT-4, GPT-4o, GPT-4o-mini, Gemini 1.5 Pro, and Claude 3.5 Sonnet. Structured prompt-engineering techniques were employed to identify and categorize negative cognitive patterns associated with depression. The proposed framework uses a modular prompt-based architecture that independently detects self-directed, world-directed, and future-oriented negative thoughts. Experimental results demonstrate that all evaluated models achieved high classification performance, with GPT-4o obtaining the highest overall accuracy and macro F1-score. The findings highlight the potential of LLMs to support automated psychological assessment and early detection of depressive thought patterns. This work contributes toward the development of AI-assisted mental health systems capable of enhancing clinical decision-making and scalable mental health screening.

Zitieren

APA

Jayannavar, L., & Kumar, T. N. R. (2026). Comparative Assessment of LLMs for Classifying Cognitive Theory Parameters in Patient-Chatbot Interactions. International Journal of Information Technology, Research and Applications, 5(2), 34-41. https://doi.org/10.59461/ijitra.v5i2.232

Vancouver

Jayannavar L, Kumar TNR. Comparative Assessment of LLMs for Classifying Cognitive Theory Parameters in Patient-Chatbot Interactions. International Journal of Information Technology, Research and Applications. 2026;5(2):34-41. doi:10.59461/ijitra.v5i2.232

BibTeX
@article{Jayannavar2026,
  author = {Jayannavar, Laxmi and Kumar, T. N. R.},
  title = {Comparative Assessment of LLMs for Classifying Cognitive Theory Parameters in Patient-Chatbot Interactions},
  journal = {International Journal of Information Technology, Research and Applications},
  year = {2026},
  volume = {5},
  number = {2},
  pages = {34--41},
  doi = {10.59461/ijitra.v5i2.232}
}
Kostenlos starten →