EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

A practical guide to the implementation of AI in orthopaedic research, Part 6: How to evaluate the performance of AI research?

Felix C Oettl iD, Ayoosh Pareek iD, Philipp W Winkler, Bálint Zsidai iD, James A Pruneski iD, Eric Hamrin Senorski iD, Sebastian Kopf, Christophe Ley, Elmar Herbst iD, Jacob F Oeding iD, Alberto Grassi, Michael T Hirschmann iD und 5 weitere

Journal of Experimental Orthopaedics · 2024-07 · 11 (3)

DOI: 10.1002/jeo2.12039 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Journal of Experimental Orthopaedics, online erschienen am 31.05.2024. Verfasst von Felix C Oettl und 16 weiteren Autor:innen. Beteiligte Einrichtung: Hospital for Special Surgery New York New York USA. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial intelligence's (AI) accelerating progress demands rigorous evaluation standards to ensure safe, effective integration into healthcare's high‐stakes decisions. As AI increasingly enables prediction, analysis and judgement capabilities relevant to medicine, proper evaluation and interpretation are indispensable. Erroneous AI could endanger patients; thus, developing, validating and deploying medical AI demands adhering to strict, transparent standards centred on safety, ethics and responsible oversight. Core considerations include assessing performance on diverse real‐world data, collaborating with domain experts, confirming model reliability and limitations, and advancing interpretability. Thoughtful selection of evaluation metrics suited to the clinical context along with testing on diverse data sets representing different populations improves generalisability. Partnering software engineers, data scientists and medical practitioners ground assessment in real needs. Journals must uphold reporting standards matching AI's societal impacts. With rigorous, holistic evaluation frameworks, AI can progress towards expanding healthcare access and quality. Level of Evidence Level V.

Schlagwörter

Stichwörter der Autor:innen

AIMLdigitalizationhealthcareperformance metrics

Autor:innen und Institutionen

  • Hospital for Special Surgery New York New York USA.
  • Schulthess Klinik Zurich Switzerland.
  • Sports Medicine and Shoulder Institute, Hospital for Special Surgery New York New York USA.
  • Department for Orthopaedics and Traumatology, Kepler University Hospital GmbH Johannes Kepler University Linz Linz Austria.
  • Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy University of Gothenburg Gothenburg Sweden.
  • Sahlgrenska Sports Medicine Center Göteborg Sweden.

ORCID-Profile: Felix C Oettl, Ayoosh Pareek, Bálint Zsidai, James A Pruneski, Eric Hamrin Senorski, Elmar Herbst, Jacob F Oeding, Michael T Hirschmann, Volker Musahl, Kristian Samuelsson, Robert Feldt

Zitieren

APA

Oettl, F. C., Pareek, A., Winkler, P. W., Zsidai, B., Pruneski, J. A., Senorski, E. H., Kopf, S., Ley, C., Herbst, E., Oeding, J. F., Grassi, A., Hirschmann, M. T., Musahl, V., Samuelsson, K., Tischer, T., Feldt, R., & ESSKA Artificial Intelligence Working Group (2024). A practical guide to the implementation of AI in orthopaedic research, Part 6: How to evaluate the performance of AI research?. Journal of Experimental Orthopaedics, 11(3). https://doi.org/10.1002/jeo2.12039

Vancouver

Oettl FC, Pareek A, Winkler PW, Zsidai B, Pruneski JA, Senorski EH, et al. A practical guide to the implementation of AI in orthopaedic research, Part 6: How to evaluate the performance of AI research?. Journal of Experimental Orthopaedics. 2024;11(3). doi:10.1002/jeo2.12039

BibTeX
@article{Oettl2024,
  author = {Oettl, Felix C and Pareek, Ayoosh and Winkler, Philipp W and Zsidai, Bálint and Pruneski, James A and Senorski, Eric Hamrin and Kopf, Sebastian and Ley, Christophe and Herbst, Elmar and Oeding, Jacob F and Grassi, Alberto and Hirschmann, Michael T and Musahl, Volker and Samuelsson, Kristian and Tischer, Thomas and Feldt, Robert and ESSKA Artificial Intelligence Working Group, ESSKA Artificial Intelligence Working Group},
  title = {A practical guide to the implementation of AI in orthopaedic research, Part 6: How to evaluate the performance of AI research?},
  journal = {Journal of Experimental Orthopaedics},
  year = {2024},
  volume = {11},
  number = {3},
  doi = {10.1002/jeo2.12039}
}
Kostenlos starten →