EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access

Comparing the Performances of a 54-Year-Old Computer-Based Consultation to ChatGPT-4o

Elvan Burak Verdi iD, Oguz Akbilgic

Applied Clinical Informatics · 01.10.2025 · 16 (05) · 1627-1636

DOI: 10.1055/a-2628-8408 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Applied Clinical Informatics, erschienen am 01.10.2025. Verfasst von Elvan Burak Verdi und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Chest Diseases, Siirt Training and Research Hospital, Siirt, Türkiye. Hauptthemen laut MEDLINE: Artificial Intelligence, Referral and Consultation. Die Arbeit nennt 19 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study aimed to evaluate and compare the diagnostic responses generated by two artificial intelligence (AI) models developed 54 years apart, and encourage physicians to explore the use of large language models (LLMs) like GPT-4o in clinical practice. A clinical case of metabolic acidosis was presented to GPT-4o, and the model's diagnostic reasoning, data interpretation, and management recommendations were recorded. These outputs were then compared with the responses from Schwartz's 1970 AI model built with a decision-tree algorithm using Conversational Algebraic Language (CAL). Both models were given the same patient data to ensure a fair comparison. GPT-4o generated an advanced analysis of the patient's acid–base disturbance, correctly identifying likely causes and suggesting relevant diagnostic tests and treatments. It provided a detailed, narrative explanation of the metabolic acidosis. The 1970 CAL model, while correctly recognizing the metabolic acidosis and flagging implausible inputs, was constrained by its rule-based design. CAL offered only basic stepwise guidance and required sequential prompts for each data point, reflecting a limited capacity to handle complex or unanticipated information. GPT-4o, by contrast, integrated the data more holistically, although it occasionally ventured beyond the provided information. This comparison illustrates substantial advances in AI capabilities over five decades. GPT-4o's performance demonstrates the transformative potential of modern LLMs in clinical decision-making, showcasing abilities to synthesize complex data and assist diagnosis without specialized training, yet necessitating further validation, rigorous clinical trials, and adaptation to clinical contexts. Although innovative for its era and offering certain advantages over GPT-4o, the rule-based CAL system had technical limitations. Rather than viewing one as simply “better,” this study provides perspective on how far AI in medicine has progressed while acknowledging that current AI tools remain supplements to—not replacements for—physician judgment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceReferral and ConsultationHumansAlgorithmsGenerative Artificial Intelligence

Autor:innen und Institutionen

  • Department of Chest Diseases, Siirt Training and Research Hospital, Siirt, Türkiye.
  • Section of Cardiovascular Medicine, Department of Internal Medicine, Wake Forest School of Medicine, Winston-Salem, United States.

ORCID-Profile: Elvan Burak Verdi

Zitieren

APA

Verdi, E. B., & Akbilgic, O. (2025). Comparing the Performances of a 54-Year-Old Computer-Based Consultation to ChatGPT-4o. Applied Clinical Informatics, 16(05), 1627-1636. https://doi.org/10.1055/a-2628-8408

Vancouver

Verdi EB, Akbilgic O. Comparing the Performances of a 54-Year-Old Computer-Based Consultation to ChatGPT-4o. Applied Clinical Informatics. 2025;16(05):1627-1636. doi:10.1055/a-2628-8408

BibTeX
@article{Verdi2025,
  author = {Verdi, Elvan Burak and Akbilgic, Oguz},
  title = {Comparing the Performances of a 54-Year-Old Computer-Based Consultation to ChatGPT-4o},
  journal = {Applied Clinical Informatics},
  year = {2025},
  volume = {16},
  number = {05},
  pages = {1627--1636},
  doi = {10.1055/a-2628-8408}
}
Kostenlos starten →