EUVIMEDEUVIMED entdecken
Crossref

Threats of common method variance in student assessment of instruction instruments

John Garger, Paul H. Jacques, Brian W. Gastle, Christine M. Connolly

Higher Education Evaluation and Development · 2019

DOI: 10.1108/heed-05-2018-0012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Higher Education Evaluation and Development, 2019. Verfasst von John Garger und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 57 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

The purpose of this paper is to demonstrate that common method variance, specifically single-source bias, threatens the validity of a university-created student assessment of instructor instrument, suggesting that decisions made from these assessments are inherently flawed or skewed. Single-source bias leads to generalizations about assessments that might influence the ability of raters to separate multiple behaviors of an instructor. Design/methodology/approach Exploratory factor analysis, nested confirmatory factor analysis and within-and-between analysis are used to assess a university-developed, proprietary student assessment of instructor instrument to determine whether a hypothesized factor structure is identifiable. The instrument was developed over a three-year period by a university-mandated committee.

Findings

Findings suggest that common method variance, specifically single-source bias, resulted in the inability to identify hypothesized constructs statistically. Additional information is needed to identify valid instruments and an effective collection method for assessment. Practical implications Institutions are not guaranteed valid or useful instruments even if they invest significant time and resources to produce one. Without accurate instrumentation, there is insufficient information to assess constructs for teaching excellence. More valid measurement criteria can result from using multiple methods, altering collection times and educating students to distinguish multiple traits and behaviors of individual instructors more accurately. Originality/value This paper documents the three-year development of a university-wide student assessment of instructor instrument and carries development through to examining the psychometric properties and appropriateness of using this instrument to evaluate instructors.

Zitieren

APA

Garger, J., Jacques, P. H., Gastle, B. W., & Connolly, C. M. (2019). Threats of common method variance in student assessment of instruction instruments. Higher Education Evaluation and Development. https://doi.org/10.1108/heed-05-2018-0012

Vancouver

Garger J, Jacques PH, Gastle BW, Connolly CM. Threats of common method variance in student assessment of instruction instruments. Higher Education Evaluation and Development. 2019. doi:10.1108/heed-05-2018-0012

BibTeX
@article{Garger2019,
  author = {Garger, John and Jacques, Paul H. and Gastle, Brian W. and Connolly, Christine M.},
  title = {Threats of common method variance in student assessment of instruction instruments},
  journal = {Higher Education Evaluation and Development},
  year = {2019},
  doi = {10.1108/heed-05-2018-0012}
}
Kostenlos starten →