EUVIMEDAtrasti EUVIMED
BeobachtungsstudieVergleichsstudieOpen access

Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study

Ke-Yun Chao iD, Chia-Hui Huang iD, Wei-Lun Liu iD, Chao-Yu Chen iD, Ai Yin Lim iD, Yi-Zhen Chu iD, Atsuko Sasaoka iD, Chung-Yu Lin iD

Journal of Medical Internet Research · 2026-06-18 · 28 · e93082

DOI: 10.2196/93082 ↗

At a glance

Beobachtungsstudie in Journal of Medical Internet Research, published online on 2026-06-18. Written by Ke-Yun Chao and 7 co-authors. Institution: Department of Respiratory Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan. Major MEDLINE topics: Cardiology, Pulmonary Medicine, Referral and Consultation, Translations. 34 references. The full text is freely available in PubMed Central.

SantraukaSubjectsBibliografiniai duomenysCiteRelated studies

Abstract (original language)

Background

Language barriers between health care providers and patients can compromise communication quality, patient safety, and health care equity. When professional interpreter services are limited, particularly in outpatient settings, artificial intelligence–based translation tools may serve as supplementary communication aids.

Objective

This study compared 3 Chinese-to-Japanese translation tools (ChatGPT, Google Translate, and UD Talk) in terms of their performance in real-world cardiology and pulmonology outpatient consultations.

Methods

In this single-center prospective observational study, audio-recorded outpatient consultations between December 2024 and November 2025 were analyzed. Verbatim physician-patient dialogues were translated using the 3 systems. Selected dialogue exchanges were evaluated by professional medical interpreters for translation accuracy and by Japanese-speaking lay participants for translation satisfaction using a 6-point Likert scale. Similarity of translation outputs was assessed at the dialogue exchange level.

Results

A total of 20 outpatient consultations comprising 2450 dialogue exchanges were analyzed. ChatGPT had significantly higher translation accuracy and satisfaction scores than Google Translate and UD Talk, with median scores of 5.0 (IQR 4.0-5.0) for both outcomes compared with 2.0 (IQR 1.0-3.0) for Google Translate and UD Talk (P

Subjects

MeSH terms (MEDLINE)

CardiologyPulmonary MedicineReferral and ConsultationTranslationsAdultFemaleHumansMaleMiddle AgedArtificial IntelligenceCommunication BarriersJapanMedical InterpretingOutpatientsProspective StudiesEast Asian People

Author keywords

AIartificial intelligencecardiopulmonary diseaselanguage barriermachine translationmedical communicationmedical interpretation

Authors and institutions

  • Department of Respiratory Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.
  • Telehealth Center, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City, Taiwan.
  • Cardiovascular and Pulmonary Rehabilitation Center, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City, Taiwan.
  • Center for Health Research and Innovation, Fu Jen Catholic University, New Taipei City, Taiwan.
  • Graduate Institute of Cross-Cultural Studies, Fu Jen Catholic University, New Taipei City, Taiwan.
  • School of Medicine, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.

ORCID profiles: Ke-Yun Chao, Chia-Hui Huang, Wei-Lun Liu, Chao-Yu Chen, Ai Yin Lim, Yi-Zhen Chu, Atsuko Sasaoka, Chung-Yu Lin

Cite

APA

Chao, K. Y., Huang, C. H., Liu, W. L., Chen, C. Y., Lim, A. Y., Chu, Y. Z., Sasaoka, A., & Lin, C. Y. (2026). Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study. Journal of Medical Internet Research, 28, e93082. https://doi.org/10.2196/93082

Vancouver

Chao KY, Huang CH, Liu WL, Chen CY, Lim AY, Chu YZ, et al. Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study. Journal of Medical Internet Research. 2026;28:e93082. doi:10.2196/93082

BibTeX
@article{Chao2026,
  author = {Chao, Ke-Yun and Huang, Chia-Hui and Liu, Wei-Lun and Chen, Chao-Yu and Lim, Ai Yin and Chu, Yi-Zhen and Sasaoka, Atsuko and Lin, Chung-Yu},
  title = {Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study},
  journal = {Journal of Medical Internet Research},
  year = {2026},
  volume = {28},
  pages = {e93082},
  doi = {10.2196/93082}
}
Start for free →