Optimal Number of Grading Levels: A Comparison of the Reliability of a 4-Point System with a 20-Point System in Assessing Practical Skills
Journal of Mashhad Dental School · 2026-08 · 50 (3) · 209-221
DOI: 10.22038/jmds.2026.28346 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Mashhad Dental School, 2026-08. Verfasst von Tannaz Abdollahzadeh Baghaei und 1 weiteren Autor:innen.
Abstract (Originalsprache)
Background
Assessing learners’ performance is a critical component of any educational system. This study investigated the agreement and reliability of using a simplified 4-point scale (A, B, C, and D) compared to the Iranian conventional 20-point grading scale for evaluating dental students' practical orthodontic skills. Methods and Materials: This cross-sectional study was conducted in Fall 2023 at the School of Dentistry, Tabriz (Iran). Seventy-five practical tasks performed by 15 fourth-year dental students enrolled in the Orthodontics Practical 1 course were evaluated. Student performance on five orthodontic tasks was independently assessed by two faculty members using both a 4-point and a 20-point grading scale. Inter-assessor agreement was assessed using weighted Cohen’s kappa for the 4-point scale and intraclass correlation coefficients (ICC) for the 20-point scale. Agreement between the two grading systems was evaluated using ICC and Bland–Altman analysis. A significance level of 0.05 was considered.
Results
The 4-point scale demonstrated moderate inter-assessor agreement (weighted kappa = 0.50), while the 20-point scale showed moderate agreement (ICC = 0.47). After conversion of the 4-point scores to their corresponding 20-point values, strong agreement was observed between the two grading systems (ICC = 0.944 and 0.969).
Conclusion
A 4-point scale may be a potential alternative to the traditional 20-point scale for assessing dental students' practical skills. This scale offers advantages in terms of simplicity and efficiency while maintaining a level of reliability. The choice between these scales ultimately depends on the specific needs and goals of the educational context
Schlagwörter
Zitieren
APA
Baghaei, T. A., & Sohrabi, A. (2026). Optimal Number of Grading Levels: A Comparison of the Reliability of a 4-Point System with a 20-Point System in Assessing Practical Skills. Journal of Mashhad Dental School, 50(3), 209-221. https://doi.org/10.22038/jmds.2026.28346
Vancouver
Baghaei TA, Sohrabi A. Optimal Number of Grading Levels: A Comparison of the Reliability of a 4-Point System with a 20-Point System in Assessing Practical Skills. Journal of Mashhad Dental School. 2026;50(3):209-221. doi:10.22038/jmds.2026.28346
BibTeX
@article{Baghaei2026,
author = {Baghaei, Tannaz Abdollahzadeh and Sohrabi, Aydin},
title = {Optimal Number of Grading Levels: A Comparison of the Reliability of a 4-Point System with a 20-Point System in Assessing Practical Skills},
journal = {Journal of Mashhad Dental School},
year = {2026},
volume = {50},
number = {3},
pages = {209--221},
doi = {10.22038/jmds.2026.28346}
}
EUVIMED