Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study
JMIR AI · 17.10.2025 · 4 · e70604
DOI: 10.2196/70604 ↗Kurz gefasst
Querschnittstudie in der Zeitschrift JMIR AI, online erschienen am 17.10.2025. Verfasst von Shinya Ito und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, Kitasato University, Sagamihara, Japan. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Mpox (monkeypox) outbreaks since 2022 have emphasized the importance of accessible health education materials. However, many Japanese online resources on mpox are difficult to understand, creating barriers for public health communication. Recent advances in artificial intelligence (AI) such as ChatGPT-4o show promise in generating more comprehensible and actionable health education content.
Objective
The aim of this study was to evaluate the comprehensibility, actionability, and readability of Japanese health education materials on mpox compared with texts generated by ChatGPT-4o.
Methods
A cross-sectional study was conducted using systematic quantitative content analysis. A total of 119 publicly available Japanese health education materials on mpox were compared with 30 texts generated by ChatGPT-4o. Websites containing videos, social media posts, academic papers, and non-Japanese language content were excluded. For generating ChatGPT-4o texts, we used 3 separate prompts with 3 different keywords. For each keyword, text generation was repeated 10 times, with prompt history deleted each time to prevent previous outputs from influencing subsequent generations and to account for output variability. The Patient Education Materials Assessment Tool for Printable Materials (PEMAT-P) was used to assess the understandability and actionability of the generated text, while the Japanese Readability Measurement System (jReadability) was used to evaluate readability. The Journal of the American Medical Association benchmark criteria were applied to evaluate the quality of the materials.
Results
A total of 119 Japanese mpox-related health education web pages and 30 ChatGPT-4o–generated texts were analyzed. AI-generated texts significantly outperformed web pages in understandability, with 80% (24/30) scoring ≥70% in PEMAT-P (P
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Nursing, Kitasato University, Sagamihara, Japan.
- University Hospital Medical Information Network Center, The University of Tokyo Hospital, Tokyo, Japan.
- Department of Health Communication, School of Public Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
ORCID-Profile: Shinya Ito, Emi Furukawa, Tsuyoshi Okuhara, Hiroko Okada, Takahiro Kiuchi
Zitieren
APA
Ito, S., Furukawa, E., Okuhara, T., Okada, H., & Kiuchi, T. (2025). Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study. JMIR AI, 4, e70604. https://doi.org/10.2196/70604
Vancouver
Ito S, Furukawa E, Okuhara T, Okada H, Kiuchi T. Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study. JMIR AI. 2025;4:e70604. doi:10.2196/70604
BibTeX
@article{Ito2025,
author = {Ito, Shinya and Furukawa, Emi and Okuhara, Tsuyoshi and Okada, Hiroko and Kiuchi, Takahiro},
title = {Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study},
journal = {JMIR AI},
year = {2025},
volume = {4},
pages = {e70604},
doi = {10.2196/70604}
}
EUVIMED