Diagnostic agreement between ChatGPT ‐based interpretation of laboratory‐generated flow cytometry graphical outputs and hematologist consensus in suspected acute leukemia
Diagnostische Übereinstimmung zwischen der ChatGPT-basierten Interpretation laborerzeugter Flowzytometrie-Grafiken und dem Konsens von Hämatolog:innen bei Verdacht auf akute Leukämie
Cytometry Part B: Clinical Cytometry · 11.11.2026
DOI: 10.1002/cyto.b.70097 ↗Auf einen Blick
Bei 560 Patient:innen mit Verdacht auf akute Leukämie zeigte ChatGPT eine diagnostische Übereinstimmung mit Hämatolog:innen; die Blastenprozent-Schätzung war stark korreliert, aber systematisch überschätzt.
Fragestellung
Wie gut stimmt ChatGPT bei der Interpretation laborerzeugter Flowzytometrie-Grafiken von Patient:innen mit Verdacht auf akute Leukämie mit dem Konsens von zwei Hämatolog:innen überein?
Methode
Retrospektive Beobachtungs-Validierungsstudie mit 560 Patient:innen; ChatGPT interpretierte de-identifizierte PDF-Flowzytometrie-Bilder via Weboberfläche. Referenzstandard war der Konsens von zwei Hämatolog:innen.
Ergebnisse
Gesamtgenauigkeit 78,8 % (95 %-KI 75,2–81,9); Cohen's κ 0,712 (95 %-KI 0,664–0,757). Blastenprozent: r = 0,818 (95 %-KI 0,789–0,844), Bias +3,92 Prozentpunkte. Hämatogonen: Genauigkeit 89,5 %.
Schlussfolgerung der Autor:innen
Die ChatGPT-basierte Flowzytometrie-Interpretation zeigte Potenzial für vorläufige diagnostische Klassifikation und Qualitätskontrolle; eine Validierung durch Expert:innen bleibt besonders bei AML, T-ALL, Blastenprozent und Hämatogonendiskrimination essenziell.
Kernaussagen
- Gesamtgenauigkeit 78,8 %; Übereinstimmung mit Hämatolog:innen substanziell
- Blastenprozent-Schätzung stark korreliert, aber um 3,92 Prozentpunkte überschätzt
- Hämatogone: Genauigkeit 89,5 %; klinische Expert:innenprüfung bleibt wichtig
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Fachartikel in der Zeitschrift Cytometry Part B: Clinical Cytometry, online erschienen am 11.11.2026. Verfasst von Mesut Göçer und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Internal Medicine, Division of Hematology, Antalya City Hospital, Antalya, Turkey. Die Arbeit nennt 19 Literaturangaben.
Abstract (Originalsprache)
Accurate, rapid, and standardized interpretation of multiparametric flow cytometry findings is essential for clinical decision‐making in patients evaluated for suspected acute leukemia. This study aimed to evaluate the diagnostic performance of ChatGPT, a general‐purpose large language model, in interpreting de‐identified, laboratory‐generated flow cytometry graphical outputs from patients with suspected acute leukemia and to assess its agreement with the consensus interpretation of two hematologists in terms of diagnostic classification, blast percentage estimation, and hematogone detection. This retrospective observational validation study included 560 patients who underwent bone marrow aspiration and flow cytometric immunophenotyping during their initial diagnostic evaluation for suspected acute leukemia. All included patients were undergoing initial diagnostic evaluation and had neither a previous diagnosis of leukemia nor prior leukemia‐directed treatment. The consensus diagnosis established by two hematologists was considered the reference standard. Between May 4 and 15, 2026, de‐identified, laboratory‐generated PDF images containing flow cytometry dot plots from a three‐tube acute leukemia panel comprising 28 antibody–fluorochrome combinations were uploaded directly through the ChatGPT Plus web interface and interpreted using GPT‐5.5 (OpenAI). Raw FCS files were not provided. Using the same standardized prompt for each case, the model was asked to estimate the blast percentage, select a single most likely diagnosis from five predefined categories (no pathology, MDS, AML, B‐ALL, or T‐ALL), and determine the presence or absence of hematogones. The initial response for each case was archived and directly encoded without adjudication. Diagnosis‐specific performance was evaluated using one‐versus‐rest sensitivity, specificity, positive predictive value, negative predictive value, accuracy, and F1‐score. Overall agreement between ChatGPT‐generated classifications and hematologist consensus was assessed using Cohen's kappa. Pearson's correlation coefficient was used to evaluate the association between blast percentage estimates, whereas Bland–Altman analysis was used to quantify agreement, systematic bias, and 95% limits of agreement. Hematogone detection was evaluated as a binary classification task using sensitivity, specificity, and accuracy. ChatGPT achieved an overall diagnostic accuracy of 78.8% (95% CI, 75.2%–81.9%), with substantial agreement with hematologist consensus (Cohen's κ = 0.712; 95% CI, 0.664–0.757). Diagnosis‐specific sensitivity ranged from 69.2% to 87.3%, and PPV ranged from 60.0% to 93.5%. The highest sensitivity was observed for MDS, whereas the highest PPV was observed for no pathology. McNemar's test identified significant systematic differences between ChatGPT and hematologist classifications for no pathology ( p = 0.041), AML ( p = 0.008), and T‐ALL ( p = 0.023). Blast percentage estimates were strongly correlated (Pearson's r = 0.818; 95% CI, 0.789–0.844; p < 0.001); however, Bland–Altman analysis demonstrated a mean positive bias of 3.92 percentage points, indicating systematic overestimation by ChatGPT. For hematogone detection, ChatGPT achieved an accuracy of 89.5%, sensitivity of 70.3%, and specificity of 92.4%. ChatGPT‐based flow cytometry interpretation showed promise for preliminary diagnostic classification and quality assurance applications. However, expert hematologist validation remains essential, particularly in scenarios associated with high diagnostic consequences, including AML and T‐ALL classification, blast percentage estimation, and accurate discrimination of hematogones.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Internal Medicine, Division of Hematology, Antalya City Hospital, Antalya, Turkey.
- Department of Internal Medicine, Antalya City Hospital, Antalya, Turkey.
- Department of Internal Medicine, Division of Hematology, Antalya Training and Research Hospital, Antalya, Turkey.
ORCID-Profile: Mesut Göçer
Zitieren
APA
Göçer, M., Aktaş, K. K., Çayır, B., & Kurtoğlu, E. (2026). Diagnostic agreement between ChatGPT ‐based interpretation of laboratory‐generated flow cytometry graphical outputs and hematologist consensus in suspected acute leukemia. Cytometry Part B: Clinical Cytometry. https://doi.org/10.1002/cyto.b.70097
Vancouver
Göçer M, Aktaş KK, Çayır B, Kurtoğlu E. Diagnostic agreement between ChatGPT ‐based interpretation of laboratory‐generated flow cytometry graphical outputs and hematologist consensus in suspected acute leukemia. Cytometry Part B: Clinical Cytometry. 2026. doi:10.1002/cyto.b.70097
BibTeX
@article{Ger2026,
author = {Göçer, Mesut and Aktaş, Kerem Kaan and Çayır, Batuhan and Kurtoğlu, Erdal},
title = {Diagnostic agreement between ChatGPT ‐based interpretation of laboratory‐generated flow cytometry graphical outputs and hematologist consensus in suspected acute leukemia},
journal = {Cytometry Part B: Clinical Cytometry},
year = {2026},
doi = {10.1002/cyto.b.70097}
}
EUVIMED