EUVIMEDEUVIMED entdecken
Crossref

Integrating Natural Language Processing With ChatGPT to Improve Quality of Artificial Intelligence Summaries of Prostate Cancer Consultations

Nadine A Friedrich iD, Sanjay K Das, Michael Luu iD, James P Daniels iD, John Heard, Avetik Barsegyan, Stephen J Freedland iD, Brennan Spiegel iD, Paul K Kokorowski, Graciela Gonzalez Hernandez, Timothy J Daskivich iD

JCO Clinical Cancer Informatics · 2026-07 · 10 (3)

DOI: 10.1200/cci-25-00199 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2026-07. Verfasst von Nadine A Friedrich und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Urology, Cedars-Sinai Medical Center, Los Angeles, CA. Hauptthemen laut MEDLINE: Prostatic Neoplasms, Natural Language Processing, Artificial Intelligence, Referral and Consultation. Die Arbeit nennt 21 Literaturangaben. Gefördert von: NCI NIH HHS, NHLBI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE Patients with prostate cancer (PC) face complex treatment decisions and often struggle to recall information from consultations. Artificial intelligence(AI)–generated summaries have potential to improve recall, but summaries of key concepts from unstructured transcripts often lack focus and quality. We investigated whether natural language processing (NLP) preprocessing before AI summarization improves topic concordance and quality of risk information in AI summaries. MATERIALS AND METHODS We audio-recorded and transcribed 42 PC consultations. Validated NLP models identified sentences about 5 content areas important for PC decision making: cancer prognosis (CP), life expectancy (LE), erectile dysfunction (ED), irritative urinary symptoms (IUS), and urinary incontinence (UI). ChatGPT-4.0 summarized raw transcripts and NLP-identified sentences across NLP probability thresholds from 50% to 90%. Summaries were reviewed for topic concordance, quality of risk information, and risk quantification. Logistic regression evaluated associations of these outcomes with NLP thresholds. RESULTS We analyzed 1,260 ChatGPT-4.0 summaries (6 per topic across 42 consultations). For each 10% increase in NLP probability threshold, the proportion of topic-related sentences in ChatGPT summaries increased by 18% for ED (incidence rate ratio [IRR], 1.18, 95% CI, 1.1 to 1.2), 16% for UI (IRR, 1.16, 95% CI, 1.1 to 1.1), 31% for IUS (IRR, 1.31; 95% CI, 1.2 to 1.3), 30% for LE (IRR, 1.30, 95% CI, 1.2 to 1.3), and 12% for CP (IRR, 1.12, 95% CI, 1.1 to 1.1). Odds of risk quantification increased for LE (odds ratio [OR], 1.39, 95% CI, 1.26 to 1.54, P < .001) and UI (OR, 1.18, 95% CI, 1.08 to 1.28, P < .001). Quality of risk information significantly increased for LE (0.16 points, 95% CI, 0.12 to 0.20) for each 10% increase in NLP threshold, with a clinically meaningful change (1 point) at a 60% threshold. CONCLUSION NLP preprocessing improves topic concordance, quality of risk information, and quantification in AI summaries of select content areas important for PC decision making, with potential to improve clinical care.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Prostatic NeoplasmsNatural Language ProcessingArtificial IntelligenceReferral and ConsultationHumansMaleGenerative Artificial IntelligenceLarge Language Models

Autor:innen und Institutionen

  • Department of Urology, Cedars-Sinai Medical Center, Los Angeles, CA.
  • Center for Integrated Research in Cancer and Lifestyle, Samuel Oschin Comprehensive Cancer Institute, Cedars-Sinai Medical Center, Los Angeles, CA.
  • Department of Computational Biomedicine, Cedars-Sinai Medical Center, Los Angeles, CA.
  • Department of Urology, UCLA Health, Los Angeles, CA.
  • Department of Surgery, Durham Veterans Affairs Health Care System, Durham, NC.
  • Biostatistics and Bioinformatics Core, Cedars-Sinai Medical Center, Los Angeles, CA.

ORCID-Profile: Nadine A Friedrich, Michael Luu, James P Daniels, Stephen J Freedland, Brennan Spiegel, Timothy J Daskivich

Förderung

  • NCI NIH HHS
  • NHLBI NIH HHS

Zitieren

APA

Friedrich, N. A., Das, S. K., Luu, M., Daniels, J. P., Heard, J., Barsegyan, A., Freedland, S. J., Spiegel, B., Kokorowski, P. K., Gonzalez Hernandez, G., & Daskivich, T. J. (2026). Integrating Natural Language Processing With ChatGPT to Improve Quality of Artificial Intelligence Summaries of Prostate Cancer Consultations. JCO Clinical Cancer Informatics, 10(3). https://doi.org/10.1200/cci-25-00199

Vancouver

Friedrich NA, Das SK, Luu M, Daniels JP, Heard J, Barsegyan A, et al. Integrating Natural Language Processing With ChatGPT to Improve Quality of Artificial Intelligence Summaries of Prostate Cancer Consultations. JCO Clinical Cancer Informatics. 2026;10(3). doi:10.1200/cci-25-00199

BibTeX
@article{Friedrich2026,
  author = {Friedrich, Nadine A and Das, Sanjay K and Luu, Michael and Daniels, James P and Heard, John and Barsegyan, Avetik and Freedland, Stephen J and Spiegel, Brennan and Kokorowski, Paul K and Gonzalez Hernandez, Graciela and Daskivich, Timothy J},
  title = {Integrating Natural Language Processing With ChatGPT to Improve Quality of Artificial Intelligence Summaries of Prostate Cancer Consultations},
  journal = {JCO Clinical Cancer Informatics},
  year = {2026},
  volume = {10},
  number = {3},
  doi = {10.1200/cci-25-00199}
}
Kostenlos starten →