EUVIMEDDescobrir EUVIMED
QuerschnittstudieOpen access

Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study

Shinya Ito iD, Emi Furukawa iD, Tsuyoshi Okuhara iD, Hiroko Okada iD, Takahiro Kiuchi iD

JMIR AI · 2025-10-17 · 4 · e70604

DOI: 10.2196/70604 ↗

At a glance

Querschnittstudie in JMIR AI, published online on 2025-10-17. Written by Shinya Ito and 4 co-authors. Institution: School of Nursing, Kitasato University, Sagamihara, Japan. Cited 4 times so far (Crossref); 24 references. The full text is freely available in PubMed Central.

ResumoSubjectsDados bibliográficosCiteRelated studies

Abstract (original language)

Background

Mpox (monkeypox) outbreaks since 2022 have emphasized the importance of accessible health education materials. However, many Japanese online resources on mpox are difficult to understand, creating barriers for public health communication. Recent advances in artificial intelligence (AI) such as ChatGPT-4o show promise in generating more comprehensible and actionable health education content.

Objective

The aim of this study was to evaluate the comprehensibility, actionability, and readability of Japanese health education materials on mpox compared with texts generated by ChatGPT-4o.

Methods

A cross-sectional study was conducted using systematic quantitative content analysis. A total of 119 publicly available Japanese health education materials on mpox were compared with 30 texts generated by ChatGPT-4o. Websites containing videos, social media posts, academic papers, and non-Japanese language content were excluded. For generating ChatGPT-4o texts, we used 3 separate prompts with 3 different keywords. For each keyword, text generation was repeated 10 times, with prompt history deleted each time to prevent previous outputs from influencing subsequent generations and to account for output variability. The Patient Education Materials Assessment Tool for Printable Materials (PEMAT-P) was used to assess the understandability and actionability of the generated text, while the Japanese Readability Measurement System (jReadability) was used to evaluate readability. The Journal of the American Medical Association benchmark criteria were applied to evaluate the quality of the materials.

Results

A total of 119 Japanese mpox-related health education web pages and 30 ChatGPT-4o–generated texts were analyzed. AI-generated texts significantly outperformed web pages in understandability, with 80% (24/30) scoring ≥70% in PEMAT-P (P

Subjects

Author keywords

AI-generated health educationJapanartificial intelligencehealth communicationmpoxpatient educationreadability

Authors and institutions

  • School of Nursing, Kitasato University, Sagamihara, Japan.
  • University Hospital Medical Information Network Center, The University of Tokyo Hospital, Tokyo, Japan.
  • Department of Health Communication, School of Public Health, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.

ORCID profiles: Shinya Ito, Emi Furukawa, Tsuyoshi Okuhara, Hiroko Okada, Takahiro Kiuchi

Cite

APA

Ito, S., Furukawa, E., Okuhara, T., Okada, H., & Kiuchi, T. (2025). Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study. JMIR AI, 4, e70604. https://doi.org/10.2196/70604

Vancouver

Ito S, Furukawa E, Okuhara T, Okada H, Kiuchi T. Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study. JMIR AI. 2025;4:e70604. doi:10.2196/70604

BibTeX
@article{Ito2025,
  author = {Ito, Shinya and Furukawa, Emi and Okuhara, Tsuyoshi and Okada, Hiroko and Kiuchi, Takahiro},
  title = {Comparison of Japanese Mpox (Monkeypox) Health Education Materials and Texts Created by Artificial Intelligence: Cross-Sectional Quantitative Content Analysis Study},
  journal = {JMIR AI},
  year = {2025},
  volume = {4},
  pages = {e70604},
  doi = {10.2196/70604}
}
Start for free →