EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence

Denise Balogh iD, Xiaoxiao Cui, Monique Mayer, Niels Koehncke, Ryan Dueck, Angelica E Lang iD

PLOS One · 09.05.2025 · 20 (5) · e0323262

DOI: 10.1371/journal.pone.0323262 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift PLOS One, online erschienen am 09.05.2025. Verfasst von Denise Balogh und 5 weiteren Autor:innen. Beteiligte Einrichtung: Canadian Center for Rural and Agricultural Health, University of Saskatchewan, Saskatoon, Saskatchewan, Canada. Hauptthemen laut MEDLINE: Artificial Intelligence. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The purpose of this study was to examine the reliability and agreement between human raters (novice, intermediate, and expert) and TuMeke Risk Suite when assessing work with the Rapid Entire Body Assessment (REBA). Twenty-one videos portraying veterinarians performing an equine radiograph were assessed with REBA by human raters and TuMeke Risk Suite (ergonomic artificial intelligence software). Intra-rater reliability of the final REBA score was highest for TuMeke Risk Suite (ICC = 1.0), then the expert rater (ICC = 0.89 (0.78–0.95)), and lowest for the novice rater (ICC = 0.51 (0.25–0.74)). Agreement between the expert rater and TuMeke Risk Suite was highest for scores of the trunk, leg, and upper arm, and lowest for the neck, wrist, and lower arm. The REBA tool in TuMeke Risk Suite may be of benefit to less experienced users to enhance reliability of their REBA assessments, especially when the trunk, legs, and upper arm are of primary interest.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceHumansReproducibility of ResultsAnimalsHorsesObserver VariationVeterinarians

Autor:innen und Institutionen

  • Canadian Center for Rural and Agricultural Health, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
  • College of Veterinary Medicine, South China Agricultural University, Guangzhou, Guangdong, China.
  • Small Animal Clinical Sciences, Western College of Veterinary Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
  • Department of Medicine, College of Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada.
  • IPM Occupational Therapy, Saskatoon, Saskatchewan, Canada.

ORCID-Profile: Denise Balogh, Angelica E Lang

Zitieren

APA

Balogh, D., Cui, X., Mayer, M., Koehncke, N., Dueck, R., & Lang, A. E. (2025). Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence. PLOS One, 20(5), e0323262. https://doi.org/10.1371/journal.pone.0323262

Vancouver

Balogh D, Cui X, Mayer M, Koehncke N, Dueck R, Lang AE. Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence. PLOS One. 2025;20(5):e0323262. doi:10.1371/journal.pone.0323262

BibTeX
@article{Balogh2025,
  author = {Balogh, Denise and Cui, Xiaoxiao and Mayer, Monique and Koehncke, Niels and Dueck, Ryan and Lang, Angelica E},
  title = {Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence},
  journal = {PLOS One},
  year = {2025},
  volume = {20},
  number = {5},
  pages = {e0323262},
  doi = {10.1371/journal.pone.0323262}
}
Kostenlos starten →