Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence
PLOS One · 09.05.2025 · 20 (5) · e0323262
DOI: 10.1371/journal.pone.0323262 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift PLOS One, online erschienen am 09.05.2025. Verfasst von Denise Balogh und 5 weiteren Autor:innen. Beteiligte Einrichtung: Canadian Center for Rural and Agricultural Health, University of Saskatchewan, Saskatoon, Saskatchewan, Canada. Hauptthemen laut MEDLINE: Artificial Intelligence. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The purpose of this study was to examine the reliability and agreement between human raters (novice, intermediate, and expert) and TuMeke Risk Suite when assessing work with the Rapid Entire Body Assessment (REBA). Twenty-one videos portraying veterinarians performing an equine radiograph were assessed with REBA by human raters and TuMeke Risk Suite (ergonomic artificial intelligence software). Intra-rater reliability of the final REBA score was highest for TuMeke Risk Suite (ICC = 1.0), then the expert rater (ICC = 0.89 (0.78–0.95)), and lowest for the novice rater (ICC = 0.51 (0.25–0.74)). Agreement between the expert rater and TuMeke Risk Suite was highest for scores of the trunk, leg, and upper arm, and lowest for the neck, wrist, and lower arm. The REBA tool in TuMeke Risk Suite may be of benefit to less experienced users to enhance reliability of their REBA assessments, especially when the trunk, legs, and upper arm are of primary interest.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Canadian Center for Rural and Agricultural Health, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
- College of Veterinary Medicine, South China Agricultural University, Guangzhou, Guangdong, China.
- Small Animal Clinical Sciences, Western College of Veterinary Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
- Department of Medicine, College of Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
- IPM Occupational Therapy, Saskatoon, Saskatchewan, Canada.
ORCID-Profile: Denise Balogh, Angelica E Lang
Zitieren
APA
Balogh, D., Cui, X., Mayer, M., Koehncke, N., Dueck, R., & Lang, A. E. (2025). Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence. PLOS One, 20(5), e0323262. https://doi.org/10.1371/journal.pone.0323262
Vancouver
Balogh D, Cui X, Mayer M, Koehncke N, Dueck R, Lang AE. Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence. PLOS One. 2025;20(5):e0323262. doi:10.1371/journal.pone.0323262
BibTeX
@article{Balogh2025,
author = {Balogh, Denise and Cui, Xiaoxiao and Mayer, Monique and Koehncke, Niels and Dueck, Ryan and Lang, Angelica E},
title = {Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence},
journal = {PLOS One},
year = {2025},
volume = {20},
number = {5},
pages = {e0323262},
doi = {10.1371/journal.pone.0323262}
}
EUVIMED