Inter- and Intrarater Reliability of the Gap–Kalamazoo Communication Skills Assessment Form Among Occupational Therapy Interns
American Journal of Occupational Therapy · 2024-07 · 78 (4) · 886-896
DOI: 10.5014/ajot.2024.050386 ↗Kurz gefasst
Fachartikel in der Zeitschrift American Journal of Occupational Therapy, online erschienen am 17.06.2024. Verfasst von Tzu-Ting Chen und 7 weiteren Autor:innen. Beteiligte Einrichtung: Tzu-Ting Chen, MS, is Occupational Therapist, Department of Psychiatry, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan, and PhD Candidate,…. Hauptthemen laut MEDLINE: Occupational Therapy, Communication, Internship and Residency, Clinical Competence. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 17 Literaturangaben.
Abstract (Originalsprache)
Importance: Effective communication skills (CS) are essential for occupational therapists. The Gap–Kalamazoo Communication Skills Assessment Form (GKCSAF) is a standard tool for assessing the CS of medical residents. However, the interrater reliability for the nine CS domain scores ranges from poor to good. The intrarater reliability remains unclear.
Objective
To examine the inter- and intrarater reliability of the GKCSAF’s nine domain scores and total score among occupational therapy interns.
Design
Repeated assessments with the GKCSAF.
Setting
Medical center psychiatry department.
Participants
Twenty-five interns and 49 clients with mental illness, recruited from August 2020 to December 2021. Outcomes and Measures: The transcripts of 50 evaluation interviews between clients and interns were used. Three independent raters assessed each transcript twice, at least 3 mo apart.
Results
The GKCSAF demonstrated poor interrater reliability for the nine domain scores (weighted κ = .08–.30) and the total score (intraclass correlation coefficient [ICC] = .22, 95% confidence interval [CI] [.10, .35]). The GKCSAF showed poor to intermediate intrarater reliability for the nine domain scores (weighted κ = .27–.73) and fair reliability for the total score (ICC = .69, 95% CI [.60, .77]). Conclusions and Relevance: The GKCSAF demonstrates poor interrater reliability and poor to intermediate intrarater reliability for the nine domain scores. However, it demonstrates fair intrarater reliability in assessing the overall CS performance of occupational therapy interns. Significant variations were observed when different raters assessed the same interns’ CS, indicating inconsistencies in ratings. Consequently, it is advisable to conservatively interpret the CS ratings obtained with the GKCSAF. Plain-Language Summary: It is essential for occupational therapists to effectively communicate with clients. The Gap–Kalamazoo Communication Skills Assessment Form (GKCSAF) is a standard tool that is used to assess the communication skills of medical residents. The study authors used the GKCSAF with occupational therapy interns in a medical center psychiatry department to assess how effectively they interviewed clients with mental illness. This study aids occupational therapy personnel in the interpretation of GKCSAF results. The study findings also highlight the importance of developing reliable and standardized measures to assess communications skills in the field of occupational therapy.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Tzu-Ting Chen, MS, is Occupational Therapist, Department of Psychiatry, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan, and PhD Candidate, School of Occupational Therapy, College of Medicine, National Taiwan…
- Yi-Ching Wang, PhD, is Postdoctoral Researcher, School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan. At the time this article was submitted, Wang was PhD Student, School of Oc…
- Tzu-Yi Wu, PhD, is Associate Professor, Department of Occupational Therapy, College of Medical and Health Sciences, Asia University, Taichung, Taiwan.
- Chyi-Rong Chen, MS, is Occupational Therapist, Department of Psychiatry, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan, and PhD Candidate, School of Occupational Therapy, College of Medicine, National Taiwan…
- Chung-Yin Cheng, BS, is Occupational Therapist, Department of Psychiatry, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan.
- I-Ping Hsueh, MS, is Professor, School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan, and Occupational Therapist, Department of Physical Medicine and Rehabilitation, National T…
Zitieren
APA
Chen, T. T., Wang, Y. C., Wu, T. Y., Chen, C. R., Cheng, C. Y., Hsueh, I. P., Wang, S. P., & Hsieh, C. L. (2024). Inter- and Intrarater Reliability of the Gap–Kalamazoo Communication Skills Assessment Form Among Occupational Therapy Interns. American Journal of Occupational Therapy, 78(4), 886-896. https://doi.org/10.5014/ajot.2024.050386
Vancouver
Chen TT, Wang YC, Wu TY, Chen CR, Cheng CY, Hsueh IP, et al. Inter- and Intrarater Reliability of the Gap–Kalamazoo Communication Skills Assessment Form Among Occupational Therapy Interns. American Journal of Occupational Therapy. 2024;78(4):886-896. doi:10.5014/ajot.2024.050386
BibTeX
@article{Chen2024,
author = {Chen, Tzu-Ting and Wang, Yi-Ching and Wu, Tzu-Yi and Chen, Chyi-Rong and Cheng, Chung-Yin and Hsueh, I-Ping and Wang, San-Ping and Hsieh, Ching-Lin},
title = {Inter- and Intrarater Reliability of the Gap–Kalamazoo Communication Skills Assessment Form Among Occupational Therapy Interns},
journal = {American Journal of Occupational Therapy},
year = {2024},
volume = {78},
number = {4},
pages = {886--896},
doi = {10.5014/ajot.2024.050386}
}
EUVIMED