Psychometric properties of automated video interview competency assessments.
Journal of Applied Psychology · 2024-06 · 109 (6) · 921-948
DOI: 10.1037/apl0001173 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Applied Psychology, 2024-06. Verfasst von Josh Liff und 4 weiteren Autor:innen. Beteiligte Einrichtung: HireVue. Hauptthemen laut MEDLINE: Psychometrics. Die Arbeit wurde bisher 44-mal zitiert (Crossref).
Abstract (Originalsprache)
Interviews are one of the most widely used selection methods, but their reliability and validity can vary substantially. Further, using human evaluators to rate an interview can be expensive and time consuming. Interview scoring models have been proposed as a mechanism for reliably, accurately, and efficiently scoring video-based interviews. Yet, there is a lack of clarity and consensus around their psychometric characteristics, primarily driven by a dearth of published empirical research. The goal of this study was to examine the psychometric properties of automated video interview competency assessments (AVI-CAs), which were designed to be highly generalizable (i.e., apply across job roles and organizations). The AVI-CAs developed demonstrated high levels of convergent validity (average r value of .66), moderate discriminant relationships (average r value of .58), good test-retest reliability (average r value of .72), and minimal levels of subgroup differences (Cohen's ds ≥ -.14). Further, criterion-related validity (uncorrected sample-weighted r¯ = .24) was demonstrated by applying these AVI-CAs to five organizational samples. Strengths, weaknesses, and future directions for building interview scoring models are also discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- HireVue.
- Department of Management, Utah State University.
ORCID-Profile: Josh Liff, Christopher J Hartwell
Zitieren
APA
Liff, J., Mondragon, N., Gardner, C., Hartwell, C. J., & Bradshaw, A. (2024). Psychometric properties of automated video interview competency assessments. Journal of Applied Psychology, 109(6), 921-948. https://doi.org/10.1037/apl0001173
Vancouver
Liff J, Mondragon N, Gardner C, Hartwell CJ, Bradshaw A. Psychometric properties of automated video interview competency assessments. Journal of Applied Psychology. 2024;109(6):921-948. doi:10.1037/apl0001173
BibTeX
@article{Liff2024,
author = {Liff, Josh and Mondragon, Nathan and Gardner, Cari and Hartwell, Christopher J and Bradshaw, Adam},
title = {Psychometric properties of automated video interview competency assessments},
journal = {Journal of Applied Psychology},
year = {2024},
volume = {109},
number = {6},
pages = {921--948},
doi = {10.1037/apl0001173}
}
EUVIMED