Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study
Journal of Medical Internet Research · 2026-06-18 · 28 · e93082
DOI: 10.2196/93082 ↗At a glance
Beobachtungsstudie in Journal of Medical Internet Research, published online on 2026-06-18. Written by Ke-Yun Chao and 7 co-authors. Institution: Department of Respiratory Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan. Major MEDLINE topics: Cardiology, Pulmonary Medicine, Referral and Consultation, Translations. 34 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Language barriers between health care providers and patients can compromise communication quality, patient safety, and health care equity. When professional interpreter services are limited, particularly in outpatient settings, artificial intelligence–based translation tools may serve as supplementary communication aids.
Objective
This study compared 3 Chinese-to-Japanese translation tools (ChatGPT, Google Translate, and UD Talk) in terms of their performance in real-world cardiology and pulmonology outpatient consultations.
Methods
In this single-center prospective observational study, audio-recorded outpatient consultations between December 2024 and November 2025 were analyzed. Verbatim physician-patient dialogues were translated using the 3 systems. Selected dialogue exchanges were evaluated by professional medical interpreters for translation accuracy and by Japanese-speaking lay participants for translation satisfaction using a 6-point Likert scale. Similarity of translation outputs was assessed at the dialogue exchange level.
Results
A total of 20 outpatient consultations comprising 2450 dialogue exchanges were analyzed. ChatGPT had significantly higher translation accuracy and satisfaction scores than Google Translate and UD Talk, with median scores of 5.0 (IQR 4.0-5.0) for both outcomes compared with 2.0 (IQR 1.0-3.0) for Google Translate and UD Talk (P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Respiratory Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.
- Telehealth Center, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City, Taiwan.
- Cardiovascular and Pulmonary Rehabilitation Center, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City, Taiwan.
- Center for Health Research and Innovation, Fu Jen Catholic University, New Taipei City, Taiwan.
- Graduate Institute of Cross-Cultural Studies, Fu Jen Catholic University, New Taipei City, Taiwan.
- School of Medicine, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.
ORCID profiles: Ke-Yun Chao, Chia-Hui Huang, Wei-Lun Liu, Chao-Yu Chen, Ai Yin Lim, Yi-Zhen Chu, Atsuko Sasaoka, Chung-Yu Lin
Cite
APA
Chao, K. Y., Huang, C. H., Liu, W. L., Chen, C. Y., Lim, A. Y., Chu, Y. Z., Sasaoka, A., & Lin, C. Y. (2026). Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study. Journal of Medical Internet Research, 28, e93082. https://doi.org/10.2196/93082
Vancouver
Chao KY, Huang CH, Liu WL, Chen CY, Lim AY, Chu YZ, et al. Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study. Journal of Medical Internet Research. 2026;28:e93082. doi:10.2196/93082
BibTeX
@article{Chao2026,
author = {Chao, Ke-Yun and Huang, Chia-Hui and Liu, Wei-Lun and Chen, Chao-Yu and Lim, Ai Yin and Chu, Yi-Zhen and Sasaoka, Atsuko and Lin, Chung-Yu},
title = {Comparative Evaluation of ChatGPT, Google Translate, and UD Talk for Chinese-to-Japanese Translation in Cardiology and Pulmonology Outpatient Consultations: Prospective Observational Study},
journal = {Journal of Medical Internet Research},
year = {2026},
volume = {28},
pages = {e93082},
doi = {10.2196/93082}
}
EUVIMED