EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Limited fitness of routinely captured student participation data for predicting graduation examination performance in undergraduate medical education

Chujie Chen, Zhen Zhang, Peng Yun

Serican Journal of Medicine · 14.06.2026 · 3 (2)

DOI: 10.17161/sjm.v3i2.25575 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Serican Journal of Medicine, online erschienen am 14.06.2026. Verfasst von Chujie Chen und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Clinical-teaching platforms now routinely capture student-level participation records, and learning analytics promises to turn these into predictions of educational outcomes. Yet the completeness, linkability, and predictive validity of such data are seldom audited, especially in new programmes where capture is still maturing.

Methods

We conducted a single-centre secondary analysis at a new tertiary teaching hospital. Teaching-participation records were linked by name, within enrolment cohort, to graduation examination scores (theory, skill, total) for three cohorts of five-year clinical-medicine interns (2022–2024). We assessed completeness, linkability, and the predictive validity of overall, domain-matched (theory- vs. skill-oriented), and rotation-based exposure, using Spearman correlations with Fisher confidence intervals, Benjamini–Hochberg correction, and cohort-fixed-effects regressions on within-cohort standardised scores.

Results

The platform held 3,216 activities and 16,391 participation records, yet only 61 students linked individually (5.5% of the 1,101-student roster), rising steeply (2, 14, 45). No association survived multiplicity correction (0 of 15). Domain-matched associations were weak, with confidence intervals spanning zero (theory exposure vs. theory ρ = 0.00; skill vs. skill ρ = 0.14), and no stronger than cross-domain placebo pairs. Rotation duration was unrelated to performance; rotation breadth correlated with theory score (ρ = 0.39, p = 0.002) but was confounded with overall participation volume. Given the small, 2024-dominated sample, the nulls exclude only moderate-to-large associations, not small effects.

Conclusions

Routinely captured teaching-participation data showed limited completeness, linkability, and predictive validity for graduation outcomes and are not yet fit for student-level prediction. Institutions considering such use should audit linkability and predictive validity before relying on participation dashboards for high-stakes inference.

Zitieren

APA

Chen, C., Zhang, Z., & Yun, P. (2026). Limited fitness of routinely captured student participation data for predicting graduation examination performance in undergraduate medical education. Serican Journal of Medicine, 3(2). https://doi.org/10.17161/sjm.v3i2.25575

Vancouver

Chen C, Zhang Z, Yun P. Limited fitness of routinely captured student participation data for predicting graduation examination performance in undergraduate medical education. Serican Journal of Medicine. 2026;3(2). doi:10.17161/sjm.v3i2.25575

BibTeX
@article{Chen2026,
  author = {Chen, Chujie and Zhang, Zhen and Yun, Peng},
  title = {Limited fitness of routinely captured student participation data for predicting graduation examination performance in undergraduate medical education},
  journal = {Serican Journal of Medicine},
  year = {2026},
  volume = {3},
  number = {2},
  doi = {10.17161/sjm.v3i2.25575}
}
Kostenlos starten →