EUVIMEDEUVIMED entdecken
Open Access

Quality of Digital Health Interventions Across Different Health Care Domains: Secondary Data Analysis Study

Maciej Hyzy iD, Raymond Bond iD, Maurice Mulvenna iD, Lu Bai iD, Alan Dix iD, Robert Daly iD, Anna-Lena Frey iD, Simon Leigh iD

JMIR mHealth and uHealth · 2023

DOI: 10.2196/47043 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR mHealth and uHealth, 2023. Verfasst von Maciej Hyzy und 7 weiteren Autor:innen. Beteiligte Einrichtung: School of Computing, Ulster University, Belfast, United Kingdom. Hauptthemen laut MEDLINE: Secondary Data Analysis, Ophthalmology. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

There are more than 350,000 digital health interventions (DHIs) in the app stores. To ensure that they are effective and safe to use, they should be assessed for compliance with best practice standards.

Objective

The objective of this paper was to examine and compare the compliance of DHIs with best practice standards and adherence to user experience (UX), professional and clinical assurance (PCA), and data privacy (DP).

Methods

We collected assessment data from 1574 DHIs using the Organisation for the Review of Care and Health Apps Baseline Review (OBR) assessment tool. As part of the assessment, each DHI received a score out of 100 for each of the abovementioned areas (ie, UX, PCA, and DP). These 3 OBR scores are combined to make up the overall ORCHA score (a proxy for quality). Inferential statistics, probability distributions, Kruskal-Wallis, Wilcoxon rank sum test, Cliff delta, and Dunn tests were used to conduct the data analysis.

Results

We found that 57.3% (902/1574) of the DHIs had an Organisation for the Review of Care and Health Apps (ORCHA) score below the threshold of 65. The overall median OBR score (ORCHA score) for all DHIs was 61.5 (IQR 51.0-73.0) out of 100. A total of 46.2% (12/26) of DHI’s health care domains had a median equal to or above the ORCHA threshold score of 65. For the 3 assessment areas (UX, DP, and PCA), DHIs scored the highest for the UX assessment 75.2 (IQR 70.0-79.6), followed by DP 65.1 (IQR 55.0-73.4) and PCA 49.6 (IQR 31.9-76.1). UX scores had the least variance (SD 13.9), while PCA scores had the most (SD 24.8). Respiratory and urology DHIs were consistently highly ranked in the National Institute for Health and Care Excellence Evidence Standards Framework tiers B and C based on their ORCHA score.

Conclusions

There is a high level of variability in the ORCHA scores of DHIs across different health care domains. This suggests that there is an urgent need to improve compliance with best practices in some health care areas. Possible explanations for the observed differences might include varied market maturity and commercial interests within the different health care domains. More investment to support the development of higher-quality DHIs in areas such as ophthalmology, allergy, women’s health, sexual health, and dental care may be needed.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Secondary Data AnalysisOphthalmologyHumansFemaleData AnalysisHealth FacilitiesPrivacy

Stichwörter der Autor:innen

ORCHA assessmentOrganisation for the Review of Care and Health Appsdigital healthdigital health interventionsdigital health interventions scoringmHealth assessmentmobile healthquality assessmentquantifying DHIs

Autor:innen und Institutionen

  • School of Computing, Ulster University, Belfast, United Kingdom.
  • School of Electronics, Electrical Engineering and Computer Science, Queen's University Belfast, Belfast, United Kingdom.
  • Swansea University, Swansea, United Kingdom.
  • Organisation for the Review of Care and Health Apps (ORCHA), Daresbury, United Kingdom.

ORCID-Profile: Maciej Hyzy, Raymond Bond, Maurice Mulvenna, Lu Bai, Alan Dix, Robert Daly, Anna-Lena Frey, Simon Leigh

Zitieren

APA

Hyzy, M., Bond, R., Mulvenna, M., Bai, L., Dix, A., Daly, R., Frey, A. L., & Leigh, S. (2023). Quality of Digital Health Interventions Across Different Health Care Domains: Secondary Data Analysis Study. JMIR mHealth and uHealth. https://doi.org/10.2196/47043

Vancouver

Hyzy M, Bond R, Mulvenna M, Bai L, Dix A, Daly R, et al. Quality of Digital Health Interventions Across Different Health Care Domains: Secondary Data Analysis Study. JMIR mHealth and uHealth. 2023. doi:10.2196/47043

BibTeX
@article{Hyzy2023,
  author = {Hyzy, Maciej and Bond, Raymond and Mulvenna, Maurice and Bai, Lu and Dix, Alan and Daly, Robert and Frey, Anna-Lena and Leigh, Simon},
  title = {Quality of Digital Health Interventions Across Different Health Care Domains: Secondary Data Analysis Study},
  journal = {JMIR mHealth and uHealth},
  year = {2023},
  doi = {10.2196/47043}
}
Kostenlos starten →