EUVIMEDEUVIMED entdecken
Crossref

Beyond Cronbach's Alpha in Dental Education Assessments: Introducing Composite Indices for Enhanced Reliability and Validity

Sivakumar Manickam iD, Tim O'Brien iD, Rachappa Malleshappa Mallikarjuna iD

European Journal of Dental Education · 29.04.2026

DOI: 10.1111/eje.70176 ↗

Kurz gefasst

Fachartikel in der Zeitschrift European Journal of Dental Education, online erschienen am 29.04.2026. Verfasst von Sivakumar Manickam und 2 weiteren Autor:innen. Beteiligte Einrichtung: Oman Dental College, Muscat, Sultanate of Oman. Die Arbeit nennt 25 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Dental educators design assessments to evaluate multiple competencies across diverse topics using items of varied difficulty levels, topical coverage, and mixed scoring weights, making them inherently multidimensional and criterion‐referenced. In practice, however the reliability of such assessments is often analysed using Cronbach alpha, one of the most widely used indices of internal consistency, despite its underlying assumptions of unidimensionality and equal item contribution.

Methods

Using a dataset of more than 200 000 item scores, we computed Cronbach's alpha at various grouping levels and analysed it alongside to other psychometric indices.

Results

(1) Dependency of Cronbach's alpha on number of items, regardless of their underlying construct; (2) At the exam level, where item diversity is intentional, this practice can penalize heterogeneity by obscuring item‐level strengths; (3) Even at finer levels, such as within a topic, the assumptions begin to break down; and (4) In contrast, the proposed composite indices provide a more consistent and diagnostically informative evaluation of assessment quality.

Conclusion

Our proposed framework: one at the item level, the Composite Item Index (CII) and another at the exam level, the Adjusted Composite Exam Index (ACEI) captures item difficulty variation along with topic coverage. Interpretation of 122 assessments using the proposed framework demonstrates greater stability, diagnostic value, and educational relevance compared to Cronbach's alpha. Monitoring CII and ACEI throughout the assessment workflow provides diagnostic insight beyond traditional reliability indices and supports psychometrically sound and balanced assessments essential for competency‐based education. Together, they offer a construct‐aware, multi‐metric framework for quality assurance.

Schlagwörter

Stichwörter der Autor:innen

Cronbach's alphaassessment reliabilitycompetency‐based assessmentdental educationitem analysispsychometrics

Autor:innen und Institutionen

  • Oman Dental College, Muscat, Sultanate of Oman.
  • University of Ulster, Coleraine, Northern Ireland, GB.

ORCID-Profile: Sivakumar Manickam, Tim O'Brien, Rachappa Malleshappa Mallikarjuna

Zitieren

APA

Manickam, S., O'Brien, T., & Mallikarjuna, R. M. (2026). Beyond Cronbach's Alpha in Dental Education Assessments: Introducing Composite Indices for Enhanced Reliability and Validity. European Journal of Dental Education. https://doi.org/10.1111/eje.70176

Vancouver

Manickam S, O'Brien T, Mallikarjuna RM. Beyond Cronbach's Alpha in Dental Education Assessments: Introducing Composite Indices for Enhanced Reliability and Validity. European Journal of Dental Education. 2026. doi:10.1111/eje.70176

BibTeX
@article{Manickam2026,
  author = {Manickam, Sivakumar and O'Brien, Tim and Mallikarjuna, Rachappa Malleshappa},
  title = {Beyond Cronbach's Alpha in Dental Education Assessments: Introducing Composite Indices for Enhanced Reliability and Validity},
  journal = {European Journal of Dental Education},
  year = {2026},
  doi = {10.1111/eje.70176}
}
Kostenlos starten →