Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems
Journal of Adolescence · 2024
DOI: 10.1002/jad.12280 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Adolescence, 2024. Verfasst von Laura Duncan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychiatry and Behavioural Neurosciences, Offord Centre for Child Studies, McMaster University, Hamilton, Ontario, Canada. Hauptthemen laut MEDLINE: Problem Behavior, Mental Disorders. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: CIHR, Canadian Institutes of Health Research, Ontario Ministry of Health and Long-Term Care.
Abstract (Originalsprache)
Introduction
Self‐completed checklists measuring youth mental health problems produce dimensional scale scores and can be converted to categorical classifications representing the presence/absence of psychopathology. We test whether categorical classifications from scale scores are equivalent psychometrically to categorical classifications of the same problems obtained by lay‐administered standardized structured diagnostic interviews.
Methods
The sample of n = 325 youth aged 12–18 (44% male) and their parent/caregivers come from combined test–retest reliability studies conducted in Ontario, Canada, from 2011 to 2015. Ontario Child Health Study Emotional Behavioural Scales‐Brief Version (OCHS‐EBS‐B) scores converted to categorical classifications of emotional and behavioral problems were compared with interview classifications. We test hypotheses of statistical equivalence and inferiority, using a confidence interval approach to detect if differences lie within the smallest effect size of interest of ±0.18. We compare categorical classifications on: (1) test–retest reliability ( ҡ ), (2) content validity (between‐instrument agreement), and (3) construct validity (strength of association with three mental health‐related constructs).
Results
Average test–retest reliabilities were 0.695 (checklists) and 0.670 (interviews). The reliability of checklist emotional problem classifications was not inferior to interview classifications and the difference in reliability between instruments for behavioral problems was small (−0.036). Average between‐instrument agreement was ҡ = 0.586 (observed) and ҡ = 0.841 (corrected for attenuation due to measurement error) indicating high content overlap. Statistical equivalence criteria were met in 5 of 6 construct validity comparisons.
Conclusions
Categorical classifications of emotional and behavioral problems from youth‐reported checklists are, on balance, equivalent to interview classifications. Checklists represent a simple, brief, inexpensive alternative to interviews.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychiatry and Behavioural Neurosciences, Offord Centre for Child Studies, McMaster University, Hamilton, Ontario, Canada.
- Child & Youth Mental Health Program, McMaster Children's Hospital, Hamilton Health Sciences, Hamilton, Ontario, Canada.
ORCID-Profile: Laura Duncan
Förderung
- CIHR
- Canadian Institutes of Health Research
- Ontario Ministry of Health and Long-Term Care
Zitieren
APA
Duncan, L., Wang, L., & Boyle, M. H. (2024). Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems. Journal of Adolescence. https://doi.org/10.1002/jad.12280
Vancouver
Duncan L, Wang L, Boyle MH. Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems. Journal of Adolescence. 2024. doi:10.1002/jad.12280
BibTeX
@article{Duncan2024,
author = {Duncan, Laura and Wang, Li and Boyle, Michael H},
title = {Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems},
journal = {Journal of Adolescence},
year = {2024},
doi = {10.1002/jad.12280}
}
EUVIMED