EUVIMEDEUVIMED entdecken
Open Access

Random Responding Detection in Two Alternative Forced Choice Tests: l z vs. Optimal Appropriateness Measurement

Naidan Tu iD, Sean Joo iD, Stephen Stark

Applied Psychological Measurement · 06.07.2026

DOI: 10.1177/01466216261467046 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Psychological Measurement, online erschienen am 06.07.2026. Verfasst von Naidan Tu und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological Sciences, Kansas State University, Manhattan, KS, USA. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multidimensional forced choice (MFC) test formats are commonly used as an alternative to traditional rating scale formats to reduce aberrant responding, especially faking in high-stakes settings. However, MFC remains susceptible to random responding, particularly in low-stakes settings where respondents may be insufficiently motivated and in high-stakes settings where some assessments may be viewed as less consequential. To ensure the validity of inferences drawn from MFC data, effective methods for detecting random responding are needed. This research contributes to the MFC literature on aberrant responding detection by evaluating the effectiveness of the item response theory (IRT)-based person fit statistic l z for detecting random responding in multi-unidimensional pairwise preference (MUPP)-based MFC tests, using optimal appropriateness measurement (OAM) as a theoretical benchmark. Two simulation studies were conducted. Study 1 compared l z with OAM, and Study 2 examined l z in a broader simulation design. Results showed that (1) higher proportions of randomly answered items, longer tests, and the use of empirical critical values were associated with greater detection power for l z , (2) the proportion of aberrant respondents did not affect l z performance, and (3) OAM outperformed l z only when the random responding model was correctly specified, a condition that can be realized in simulation but may not hold in applied testing contexts. Overall, the findings support the use of l z with empirical critical values as a practical method for detecting random responding in MUPP-based MFC tests.

Schlagwörter

Stichwörter der Autor:innen

aberrant responding detectionlzmulti-unidimensional pairwise preference (MUPP)multidimensional forced choice (MFC)optimal appropriateness measurementrandom responding

Autor:innen und Institutionen

  • Department of Psychological Sciences, Kansas State University, Manhattan, KS, USA.
  • Department of Educational Psychology, University of Kansas, Lawrence, KS, USA.
  • Department of Psychology, University of South Florida, Tampa, FL, USA.

ORCID-Profile: Naidan Tu, Sean Joo

Zitieren

APA

Tu, N., Joo, S., & Stark, S. (2026). Random Responding Detection in Two Alternative Forced Choice Tests: l z vs. Optimal Appropriateness Measurement. Applied Psychological Measurement. https://doi.org/10.1177/01466216261467046

Vancouver

Tu N, Joo S, Stark S. Random Responding Detection in Two Alternative Forced Choice Tests: l z vs. Optimal Appropriateness Measurement. Applied Psychological Measurement. 2026. doi:10.1177/01466216261467046

BibTeX
@article{Tu2026,
  author = {Tu, Naidan and Joo, Sean and Stark, Stephen},
  title = {Random Responding Detection in Two Alternative Forced Choice Tests: l z vs. Optimal Appropriateness Measurement},
  journal = {Applied Psychological Measurement},
  year = {2026},
  doi = {10.1177/01466216261467046}
}
Kostenlos starten →