Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?
Medical Education · 2024-12 · 58 (12) · 1462-1468
DOI: 10.1111/medu.15452 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Medical Education, online erschienen am 13.06.2024. Verfasst von David Wei Dai und 5 weiteren Autor:innen. Beteiligte Einrichtung: UCL Institute of Education, University College London, London, UK. Hauptthemen laut MEDLINE: Health Occupations. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Context
One central consideration in health professions education (HPE) is to ensure we are making sound and justifiable decisions based on the assessment instruments we use on health professionals. To achieve this goal, HPE assessment researchers have drawn on Kane's argument‐based framework to ascertain the validity of their assessment tools. However, the original four‐inference model proposed by Kane – frequently used in HPE validation research – has its limitations in terms of what each inference entails and what claims and sources of backing are housed in each inference. The under‐specification in the four‐inference model has led to inconsistent practices in HPE validation research, posing challenges for (i) researchers who want to evaluate the validity of different HPE assessment tools and/or (ii) researchers who are new to test validation and need to establish a coherent understanding of argument‐based validation.
Methods
To address these identified concerns, this article introduces the expanded seven‐inference argument‐based validation framework that is established practice in the field of language testing and assessment (LTA). We explicate (i) why LTA researchers experienced the need to further specify the original four Kanean inferences; (ii) how LTA validation research defines each of their seven inferences and (iii) what claims, assumptions and sources of backing are associated with each inference. Sampling six representative validation studies in HPE, we demonstrate why an expanded model and a shared disciplinary validation framework can facilitate the examination of the validity evidence in diverse HPE validation contexts.
Conclusions
We invite HPE validation researchers to experiment with the seven‐inference argument‐based framework from LTA to evaluate its usefulness to HPE. We also call for greater interdisciplinary dialogue between HPE and LTA since both disciplines share many fundamental concerns about language use, communication skills, assessment practices and validity in assessment instruments.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- UCL Institute of Education, University College London, London, UK.
- Faculty of Pharmacy and Pharmaceutical Sciences, Monash University, Parkville, Melbourne, Victoria, Australia.
- Language Testing Research Centre, The University of Melbourne, Parkville, Melbourne, Victoria, Australia.
- Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia.
ORCID-Profile: David Wei Dai, Thao Vu, Ute Knoch, Angelina S Lim, Daniel Thomas Malone, Vivienne Mak
Zitieren
APA
Dai, D. W., Vu, T., Knoch, U., Lim, A. S., Malone, D. T., & Mak, V. (2024). Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?. Medical Education, 58(12), 1462-1468. https://doi.org/10.1111/medu.15452
Vancouver
Dai DW, Vu T, Knoch U, Lim AS, Malone DT, Mak V. Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?. Medical Education. 2024;58(12):1462-1468. doi:10.1111/medu.15452
BibTeX
@article{Dai2024,
author = {Dai, David Wei and Vu, Thao and Knoch, Ute and Lim, Angelina S and Malone, Daniel Thomas and Mak, Vivienne},
title = {Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?},
journal = {Medical Education},
year = {2024},
volume = {58},
number = {12},
pages = {1462--1468},
doi = {10.1111/medu.15452}
}
EUVIMED