Threats of common method variance in student assessment of instruction instruments
Higher Education Evaluation and Development · 2019
DOI: 10.1108/heed-05-2018-0012 ↗Kurz gefasst
Fachartikel in der Zeitschrift Higher Education Evaluation and Development, 2019. Verfasst von John Garger und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 57 Literaturangaben.
Abstract (Originalsprache)
Purpose
The purpose of this paper is to demonstrate that common method variance, specifically single-source bias, threatens the validity of a university-created student assessment of instructor instrument, suggesting that decisions made from these assessments are inherently flawed or skewed. Single-source bias leads to generalizations about assessments that might influence the ability of raters to separate multiple behaviors of an instructor. Design/methodology/approach Exploratory factor analysis, nested confirmatory factor analysis and within-and-between analysis are used to assess a university-developed, proprietary student assessment of instructor instrument to determine whether a hypothesized factor structure is identifiable. The instrument was developed over a three-year period by a university-mandated committee.
Findings
Findings suggest that common method variance, specifically single-source bias, resulted in the inability to identify hypothesized constructs statistically. Additional information is needed to identify valid instruments and an effective collection method for assessment. Practical implications Institutions are not guaranteed valid or useful instruments even if they invest significant time and resources to produce one. Without accurate instrumentation, there is insufficient information to assess constructs for teaching excellence. More valid measurement criteria can result from using multiple methods, altering collection times and educating students to distinguish multiple traits and behaviors of individual instructors more accurately. Originality/value This paper documents the three-year development of a university-wide student assessment of instructor instrument and carries development through to examining the psychometric properties and appropriateness of using this instrument to evaluate instructors.
Zitieren
APA
Garger, J., Jacques, P. H., Gastle, B. W., & Connolly, C. M. (2019). Threats of common method variance in student assessment of instruction instruments. Higher Education Evaluation and Development. https://doi.org/10.1108/heed-05-2018-0012
Vancouver
Garger J, Jacques PH, Gastle BW, Connolly CM. Threats of common method variance in student assessment of instruction instruments. Higher Education Evaluation and Development. 2019. doi:10.1108/heed-05-2018-0012
BibTeX
@article{Garger2019,
author = {Garger, John and Jacques, Paul H. and Gastle, Brian W. and Connolly, Christine M.},
title = {Threats of common method variance in student assessment of instruction instruments},
journal = {Higher Education Evaluation and Development},
year = {2019},
doi = {10.1108/heed-05-2018-0012}
}
EUVIMED