Consistency between inter-institutional panels using a three-level Angoff-standard setting in licensure tests of foreign-trained dentists in Sweden: A cohort study
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0313476 ↗Kurz gefasst
Kohortenstudie in der Zeitschrift PLOS ONE, 2024. Verfasst von Jesper Dalum und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Dental Medicine, Division of Oral Diagnostics and Rehabilitation, Karolinska Institutet, Stockholm, Sweden. Hauptthemen laut MEDLINE: Dentists, Clinical Competence. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Licensure exams play a crucial role in ensuring the competence of individuals entering a profession, thereby safeguarding the public and maintaining the quality and integrity of the profession. In Sweden, dentists educated outside the European Union seeking to practise dentistry must undergoa re-certification process. The re-certification process includes a theoretical examination where pass marks are set using a three-level Angoff method. This study aimed to determine the consistency of the Angoff ratings using independent panels at two Swedish universities. Two cohorts of panellists were included in the study: one reference and one external. The reference panel was responsible for rating the upcoming theoretical examinations in the proficiency test, which were used to set the pass mark. The external panel, recruited from a dental school at a university in another region in Sweden, provided ratings after the examinations. Three examinations during 2019–2020 were included in this study (267 items in total). There was a strong correlation (ρ ≥ 0.70, p < .001) between the ratings of the two independent panels, with no significant differences in item ratings across the full exams, dental disciplines, and professional qualifications analysed. This suggests that the three-level Angoff method reliably produces similar standards for assessing the competence of the minimally qualified dentist across different institutions. The expectations of the minimally qualified but still acceptable dentist were comparable between the two independent panels across the three theoretical examinations explored. The alignment between the panels indicates valid, reliable standards across institutions, despite the independent syllabi of the two study programmes. However, while there is an alignment, differences in ratings remain. Consequently, involving multiple institutions in future standard-setting processes could help ensure that the standards reflect a broader range of educational practices, supporting the credibility of licensure examinations.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Dental Medicine, Division of Oral Diagnostics and Rehabilitation, Karolinska Institutet, Stockholm, Sweden.
- Department of Orthodontics, Faculty of Odontology, Malmö University, Malmö, Sweden.
- Department of Clinical Science and Education, Södersjukhuset, Karolinska Institutet, Stockholm, Sweden.
- Department Learning, Informatics, Management and Ethics, Karolinska Institutet, Stockholm, Sweden.
- Faculty of Health and Social Sciences, Western Norway University of Applied Sciences, Bergen, Norway.
- Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden.
ORCID-Profile: Jesper Dalum, Liselotte Paulsson, Nikolaos Christidis, Klas Karlgren, Gunilla Sandborgh-Englund
Zitieren
APA
Dalum, J., Paulsson, L., Christidis, N., Andersson Franko, M., Karlgren, K., Leanderson, C., & Sandborgh-Englund, G. (2024). Consistency between inter-institutional panels using a three-level Angoff-standard setting in licensure tests of foreign-trained dentists in Sweden: A cohort study. PLOS ONE. https://doi.org/10.1371/journal.pone.0313476
Vancouver
Dalum J, Paulsson L, Christidis N, Andersson Franko M, Karlgren K, Leanderson C, et al. Consistency between inter-institutional panels using a three-level Angoff-standard setting in licensure tests of foreign-trained dentists in Sweden: A cohort study. PLOS ONE. 2024. doi:10.1371/journal.pone.0313476
BibTeX
@article{Dalum2024,
author = {Dalum, Jesper and Paulsson, Liselotte and Christidis, Nikolaos and Andersson Franko, Mikael and Karlgren, Klas and Leanderson, Charlotte and Sandborgh-Englund, Gunilla},
title = {Consistency between inter-institutional panels using a three-level Angoff-standard setting in licensure tests of foreign-trained dentists in Sweden: A cohort study},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0313476}
}
EUVIMED