EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?

David Wei Dai iD, Thao Vu iD, Ute Knoch iD, Angelina S Lim iD, Daniel Thomas Malone iD, Vivienne Mak iD

Medical Education · 2024-12 · 58 (12) · 1462-1468

DOI: 10.1111/medu.15452 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Medical Education, online erschienen am 13.06.2024. Verfasst von David Wei Dai und 5 weiteren Autor:innen. Beteiligte Einrichtung: UCL Institute of Education, University College London, London, UK. Hauptthemen laut MEDLINE: Health Occupations. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Context

One central consideration in health professions education (HPE) is to ensure we are making sound and justifiable decisions based on the assessment instruments we use on health professionals. To achieve this goal, HPE assessment researchers have drawn on Kane's argument‐based framework to ascertain the validity of their assessment tools. However, the original four‐inference model proposed by Kane – frequently used in HPE validation research – has its limitations in terms of what each inference entails and what claims and sources of backing are housed in each inference. The under‐specification in the four‐inference model has led to inconsistent practices in HPE validation research, posing challenges for (i) researchers who want to evaluate the validity of different HPE assessment tools and/or (ii) researchers who are new to test validation and need to establish a coherent understanding of argument‐based validation.

Methods

To address these identified concerns, this article introduces the expanded seven‐inference argument‐based validation framework that is established practice in the field of language testing and assessment (LTA). We explicate (i) why LTA researchers experienced the need to further specify the original four Kanean inferences; (ii) how LTA validation research defines each of their seven inferences and (iii) what claims, assumptions and sources of backing are associated with each inference. Sampling six representative validation studies in HPE, we demonstrate why an expanded model and a shared disciplinary validation framework can facilitate the examination of the validity evidence in diverse HPE validation contexts.

Conclusions

We invite HPE validation researchers to experiment with the seven‐inference argument‐based framework from LTA to evaluate its usefulness to HPE. We also call for greater interdisciplinary dialogue between HPE and LTA since both disciplines share many fundamental concerns about language use, communication skills, assessment practices and validity in assessment instruments.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Health OccupationsHumansReproducibility of ResultsLanguageEducational MeasurementLanguage Tests

Autor:innen und Institutionen

  • UCL Institute of Education, University College London, London, UK.
  • Faculty of Pharmacy and Pharmaceutical Sciences, Monash University, Parkville, Melbourne, Victoria, Australia.
  • Language Testing Research Centre, The University of Melbourne, Parkville, Melbourne, Victoria, Australia.
  • Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Australia.

ORCID-Profile: David Wei Dai, Thao Vu, Ute Knoch, Angelina S Lim, Daniel Thomas Malone, Vivienne Mak

Zitieren

APA

Dai, D. W., Vu, T., Knoch, U., Lim, A. S., Malone, D. T., & Mak, V. (2024). Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?. Medical Education, 58(12), 1462-1468. https://doi.org/10.1111/medu.15452

Vancouver

Dai DW, Vu T, Knoch U, Lim AS, Malone DT, Mak V. Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?. Medical Education. 2024;58(12):1462-1468. doi:10.1111/medu.15452

BibTeX
@article{Dai2024,
  author = {Dai, David Wei and Vu, Thao and Knoch, Ute and Lim, Angelina S and Malone, Daniel Thomas and Mak, Vivienne},
  title = {Expanding Kane's argument‐based validity framework: What can validation practices in language assessment offer health professions education?},
  journal = {Medical Education},
  year = {2024},
  volume = {58},
  number = {12},
  pages = {1462--1468},
  doi = {10.1111/medu.15452}
}
Kostenlos starten →