EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Game based assessments of cognitive ability in recruitment: Validity, fairness and test-taking experience

Franziska Leutner, Sonia-Cristina Codreanu, Suzanne Brink, Theodoros Bitsakis

Frontiers in Psychology · 18.01.2023 · 13

DOI: 10.3389/fpsyg.2022.942662 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 18.01.2023. Verfasst von Franziska Leutner und 3 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Management Studies, Goldsmiths, University of London, London, United Kingdom. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 95 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Gamification and machine learning are emergent technologies in recruitment, promising to improve the user experience and fairness of assessments. We test this by validating a game based assessment of cognitive ability with a machine learning based scoring algorithm optimised for validity and fairness. We use applied data from 11,574 assessment completions. The assessment has convergent validity ( r = 0.5) and test–retest reliability ( r = 0.68). It maintains fairness in a separate sample of 3,107 job applicants, showing that fairness-optimised machine learning can improve outcome parity issues with cognitive ability tests in recruitment settings. We show that there are no significant gender differences in test taking anxiety resulting from the games, and that anxiety does not directly predict game performance, supporting the notion that game based assessments help with test taking anxiety. Interactions between anxiety, gender and performance are explored. Feedback from 4,778 job applicants reveals a Net Promoter score of 58, indicating more applicants support than dislike the assessment, and that games deliver a positive applicant experience in practise. Satisfaction with the format is high, but applicants raise face validity concerns over the abstract games. We encourage the use of gamification and machine learning to improve the fairness and user experience of psychometric tests.

Schlagwörter

Stichwörter der Autor:innen

adverse impactcognitive abilityfairnessgame based assessmentoutcome paritypsychometric testsrecruitmentuser experience

Autor:innen und Institutionen

  • Institute of Management Studies, Goldsmiths, University of London, London, United Kingdom.
  • HireVue, Inc, Salt Lake City, UT, United States.
  • King's College London, London, United Kingdom.

Zitieren

APA

Leutner, F., Codreanu, S. C., Brink, S., & Bitsakis, T. (2023). Game based assessments of cognitive ability in recruitment: Validity, fairness and test-taking experience. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.942662

Vancouver

Leutner F, Codreanu SC, Brink S, Bitsakis T. Game based assessments of cognitive ability in recruitment: Validity, fairness and test-taking experience. Frontiers in Psychology. 2023;13. doi:10.3389/fpsyg.2022.942662

BibTeX
@article{Leutner2023,
  author = {Leutner, Franziska and Codreanu, Sonia-Cristina and Brink, Suzanne and Bitsakis, Theodoros},
  title = {Game based assessments of cognitive ability in recruitment: Validity, fairness and test-taking experience},
  journal = {Frontiers in Psychology},
  year = {2023},
  volume = {13},
  doi = {10.3389/fpsyg.2022.942662}
}
Kostenlos starten →