EUVIMEDObjevte EUVIMED
Open access

The Clinical Suitability of an Artificial Intelligence–Enabled Pain Assessment Tool for Use in Infants: Feasibility and Usability Evaluation Study

Jeffery David Hughes iD, Paola Chivers iD, Kreshnik Hoti iD

Journal of Medical Internet Research · 2023-02-13 · 25 · e41992

DOI: 10.2196/41992 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2023-02-13. Written by Jeffery David Hughes and 2 co-authors. Institution: Curtin Medical School, Curtin University, Perth, Australia. Major MEDLINE topics: Artificial Intelligence, Procedural Pain. Cited 30 times so far (Crossref); 42 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

Infants are unable to self-report their pain, which, therefore, often goes underrecognized and undertreated. Adequate assessment of pain, including procedural pain, which has short- and long-term consequences, is critical for its management. The introduction of mobile health–based (mHealth) pain assessment tools could address current challenges and is an area requiring further research.

Objective

The purpose of this study is to evaluate the accuracy and feasibility aspects of PainChek Infant and, therefore, assess its applicability in the intended setting.

Methods

By observing infants just before, during, and after immunization, we evaluated the accuracy and precision at different cutoff scores of PainChek Infant, which is a point-of-care mHealth–based solution that uses artificial intelligence to detect pain and intensity based solely on facial expression. We used receiver operator characteristic analysis to assess interpretability and establish a cutoff score. Clinician comprehensibility was evaluated using a standardized questionnaire. Other feasibility aspects were evaluated based on comparison with currently available observational pain assessment tools for use in infants with procedural pain.

Results

Both PainChek Infant Standard and Adaptive modes demonstrated high accuracy (area under the curve 0.964 and 0.966, respectively). At a cutoff score of ≥2, accuracy and precision were 0.908 and 0.912 for Standard and 0.912 and 0.897 for Adaptive modes, respectively. Currently available data allowed evaluation of 16 of the 17 feasibility aspects, with only the cost of the outcome measurement instrument unable to be evaluated since it is yet to be determined. PainChek Infant performed well across feasibility aspects, including interpretability (cutoff score defined), ease of administration, completion time (3 seconds), and clinician comprehensibility.

Conclusions

This work provides information on the feasibility of using PainChek Infant in clinical practice for procedural pain assessment and monitoring, and demonstrates the accuracy and precision of the tool at the defined cutoff score.

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceProcedural PainHumansInfantFeasibility StudiesPain MeasurementPain

Author keywords

PainChek Infantaccuracyartificial intelligenceassessmentbabiesbabyclinical utilitydetectionfacialimmunizationinfantmachine learningmodelnewbornpain

Authors and institutions

  • Curtin Medical School, Curtin University, Perth, Australia.
  • Institute for Health Research, The University of Notre Dame Australia, Fremantle, Australia.
  • School of Medical and Health Sciences, Edith Cowan University, Perth, Australia.
  • Faculty of Medicine, University of Prishtina, Prishtina, Kosovo.

ORCID profiles: Jeffery David Hughes, Paola Chivers, Kreshnik Hoti

Cite

APA

Hughes, J. D., Chivers, P., & Hoti, K. (2023). The Clinical Suitability of an Artificial Intelligence–Enabled Pain Assessment Tool for Use in Infants: Feasibility and Usability Evaluation Study. Journal of Medical Internet Research, 25, e41992. https://doi.org/10.2196/41992

Vancouver

Hughes JD, Chivers P, Hoti K. The Clinical Suitability of an Artificial Intelligence–Enabled Pain Assessment Tool for Use in Infants: Feasibility and Usability Evaluation Study. Journal of Medical Internet Research. 2023;25:e41992. doi:10.2196/41992

BibTeX
@article{Hughes2023,
  author = {Hughes, Jeffery David and Chivers, Paola and Hoti, Kreshnik},
  title = {The Clinical Suitability of an Artificial Intelligence–Enabled Pain Assessment Tool for Use in Infants: Feasibility and Usability Evaluation Study},
  journal = {Journal of Medical Internet Research},
  year = {2023},
  volume = {25},
  pages = {e41992},
  doi = {10.2196/41992}
}
Start for free →