EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems

Laura Duncan iD, Li Wang, Michael H Boyle

Journal of Adolescence · 2024

DOI: 10.1002/jad.12280 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Adolescence, 2024. Verfasst von Laura Duncan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychiatry and Behavioural Neurosciences, Offord Centre for Child Studies, McMaster University, Hamilton, Ontario, Canada. Hauptthemen laut MEDLINE: Problem Behavior, Mental Disorders. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: CIHR, Canadian Institutes of Health Research, Ontario Ministry of Health and Long-Term Care.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Self‐completed checklists measuring youth mental health problems produce dimensional scale scores and can be converted to categorical classifications representing the presence/absence of psychopathology. We test whether categorical classifications from scale scores are equivalent psychometrically to categorical classifications of the same problems obtained by lay‐administered standardized structured diagnostic interviews.

Methods

The sample of n = 325 youth aged 12–18 (44% male) and their parent/caregivers come from combined test–retest reliability studies conducted in Ontario, Canada, from 2011 to 2015. Ontario Child Health Study Emotional Behavioural Scales‐Brief Version (OCHS‐EBS‐B) scores converted to categorical classifications of emotional and behavioral problems were compared with interview classifications. We test hypotheses of statistical equivalence and inferiority, using a confidence interval approach to detect if differences lie within the smallest effect size of interest of ±0.18. We compare categorical classifications on: (1) test–retest reliability ( ҡ ), (2) content validity (between‐instrument agreement), and (3) construct validity (strength of association with three mental health‐related constructs).

Results

Average test–retest reliabilities were 0.695 (checklists) and 0.670 (interviews). The reliability of checklist emotional problem classifications was not inferior to interview classifications and the difference in reliability between instruments for behavioral problems was small (−0.036). Average between‐instrument agreement was ҡ = 0.586 (observed) and ҡ = 0.841 (corrected for attenuation due to measurement error) indicating high content overlap. Statistical equivalence criteria were met in 5 of 6 construct validity comparisons.

Conclusions

Categorical classifications of emotional and behavioral problems from youth‐reported checklists are, on balance, equivalent to interview classifications. Checklists represent a simple, brief, inexpensive alternative to interviews.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Problem BehaviorMental DisordersChildHumansMaleAdolescentFemaleChecklistReproducibility of ResultsPsychiatric Status Rating ScalesPsychometrics

Stichwörter der Autor:innen

child psychiatric disordermeasurementproblem checklistreliabilitystructural equation modelingstructured diagnostic interviewvalidity

Autor:innen und Institutionen

  • Department of Psychiatry and Behavioural Neurosciences, Offord Centre for Child Studies, McMaster University, Hamilton, Ontario, Canada.
  • Child & Youth Mental Health Program, McMaster Children's Hospital, Hamilton Health Sciences, Hamilton, Ontario, Canada.

ORCID-Profile: Laura Duncan

Förderung

  • CIHR
  • Canadian Institutes of Health Research
  • Ontario Ministry of Health and Long-Term Care

Zitieren

APA

Duncan, L., Wang, L., & Boyle, M. H. (2024). Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems. Journal of Adolescence. https://doi.org/10.1002/jad.12280

Vancouver

Duncan L, Wang L, Boyle MH. Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems. Journal of Adolescence. 2024. doi:10.1002/jad.12280

BibTeX
@article{Duncan2024,
  author = {Duncan, Laura and Wang, Li and Boyle, Michael H},
  title = {Comparing the reliability and validity of youth‐reported checklists and standardized interviews for categorical measurement of emotional and behavioral problems},
  journal = {Journal of Adolescence},
  year = {2024},
  doi = {10.1002/jad.12280}
}
Kostenlos starten →