EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

Assessing the Reliability and Validity of Principles for Health-Related Information on Social Media (PRHISM) for Evaluating Breast Cancer Treatment Videos on YouTube: Instrument Validation Study

Hiroki Kusama iD, Yoshimitsu Takahashi iD, Shunichiro Orihara iD, Kayo Adachi iD, Yumiko Ishizuka iD, Ryoko Semba iD, Hidetaka Shima iD, Yoshiya Horimoto iD, Hiroshi Kaise iD, Masataka Taguri iD, Sho Inoue iD, Takeo Nakayama iD und 1 weitere

JMIR Infodemiology · 11.06.2025 · 5 · e66416-e66416

DOI: 10.2196/66416 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift JMIR Infodemiology, online erschienen am 11.06.2025. Verfasst von Hiroki Kusama und 12 weiteren Autor:innen. Beteiligte Einrichtung: Department of Breast Surgical Oncology, Tokyo Medical University Hospital, 6-7-1, Nishishinjuku, Shinjuku-ku, Tokyo, 160-0023, Japan, 81 3-3342-6111. Hauptthemen laut MEDLINE: Social Media, Breast Neoplasms, Video Recording, Consumer Health Information. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

There is breast cancer–related medical information on social media, but there is no established method for objectively evaluating the quality of this information. Principles for Health-Related Information on Social Media (PRHISM) is a newly developed tool for objectively assessing the quality of health-related information on social media; however, there have been no reports evaluating its reliability and validity.

Objective

The purpose of this study was to statistically examine the reliability and validity of PRHISM using videos about breast cancer treatment on YouTube (Google).

Methods

In total, 60 YouTube videos were selected on January 5, 2024, with the Japanese words for “breast cancer,” “treatment,” and “chemotherapy,” and assessed by 6 Japanese physicians with expertise in breast cancer. These evaluators independently evaluated the videos using PRHISM and an established tool for assessing the quality of health-related information, DISCERN, as well as through subjective assessments. We calculated interrater and intrarater agreement among evaluators with CIs, measuring agreement using weighted Cohen kappa.

Results

The interrater agreement for PRHISM overall quality was κ=0.52 (90% CI 0.49-0.55), indicating that the expected level of agreement, statistically defined by the lower limit of the 90% CI exceeding 0.53, was not achieved. However, PRHISM demonstrated higher agreement compared with DISCERN overall quality, which had a κ=0.45 (90% CI 0.41-0.48). In terms of validity, the intrarater agreement between PRHISM and subjective assessments by breast experts was κ=0.37 (95% CI 0.14-0.60), while DISCERN showed an agreement of κ=0.27 (95% CI 0.07-0.48), indicating fair agreement and no significant difference in validity.

Conclusions

PRHISM has demonstrated sufficient reliability and validity for evaluating the quality of health-related information on YouTube, making it a promising new metric. To further enhance objectivity, it is necessary to explore the use of artificial intelligence and other approaches.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Social MediaBreast NeoplasmsVideo RecordingConsumer Health InformationHumansReproducibility of ResultsFemaleJapan

Stichwörter der Autor:innen

JapanPRHISMPrinciples for Health-Related Information on Social MediaYouTubebreast cancer treatmentcancer treatmentinformation qualityinstrument validation studymedical informationonline health informationreliabilitysocial mediavalidityvideos

Autor:innen und Institutionen

  • Department of Breast Surgical Oncology, Tokyo Medical University Hospital, 6-7-1, Nishishinjuku, Shinjuku-ku, Tokyo, 160-0023, Japan, 81 3-3342-6111.
  • Department of Implementation Science in Public Health, School of Public Health, Kyoto University, Kyoto, Japan.
  • Department of Health Data Science, Tokyo Medical University Hospital, Tokyo, Japan.
  • Department of Breast Oncology, Faculty of Medicine, Juntendo University, Tokyo, Japan.
  • Department of Breast Surgery, Douaikai Ozawa Hospital, Kanagawa, Japan.
  • Department of Breast Surgical Oncology, Tokyo Medical University Ibaraki Medical Center, Ibaraki, Japan.

ORCID-Profile: Hiroki Kusama, Yoshimitsu Takahashi, Shunichiro Orihara, Kayo Adachi, Yumiko Ishizuka, Ryoko Semba, Hidetaka Shima, Yoshiya Horimoto, Hiroshi Kaise, Masataka Taguri, Sho Inoue, Takeo Nakayama, Takashi Ishikawa

Zitieren

APA

Kusama, H., Takahashi, Y., Orihara, S., Adachi, K., Ishizuka, Y., Semba, R., Shima, H., Horimoto, Y., Kaise, H., Taguri, M., Inoue, S., Nakayama, T., & Ishikawa, T. (2025). Assessing the Reliability and Validity of Principles for Health-Related Information on Social Media (PRHISM) for Evaluating Breast Cancer Treatment Videos on YouTube: Instrument Validation Study. JMIR Infodemiology, 5, e66416-e66416. https://doi.org/10.2196/66416

Vancouver

Kusama H, Takahashi Y, Orihara S, Adachi K, Ishizuka Y, Semba R, et al. Assessing the Reliability and Validity of Principles for Health-Related Information on Social Media (PRHISM) for Evaluating Breast Cancer Treatment Videos on YouTube: Instrument Validation Study. JMIR Infodemiology. 2025;5:e66416-e66416. doi:10.2196/66416

BibTeX
@article{Kusama2025,
  author = {Kusama, Hiroki and Takahashi, Yoshimitsu and Orihara, Shunichiro and Adachi, Kayo and Ishizuka, Yumiko and Semba, Ryoko and Shima, Hidetaka and Horimoto, Yoshiya and Kaise, Hiroshi and Taguri, Masataka and Inoue, Sho and Nakayama, Takeo and Ishikawa, Takashi},
  title = {Assessing the Reliability and Validity of Principles for Health-Related Information on Social Media (PRHISM) for Evaluating Breast Cancer Treatment Videos on YouTube: Instrument Validation Study},
  journal = {JMIR Infodemiology},
  year = {2025},
  volume = {5},
  pages = {e66416--e66416},
  doi = {10.2196/66416}
}
Kostenlos starten →