Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy
Clinical Psychology & Psychotherapy · 2026
DOI: 10.1002/cpp.70239 ↗At a glance
Journal article in Clinical Psychology & Psychotherapy, 2026. Written by Danilo Moggia and 4 co-authors. Institution: Serra Hunter Fellow, Autonomous University of Barcelona, Barcelona, Spain. Major MEDLINE topics: Cognitive Behavioral Therapy, Mobile Applications, Smartphone, Mental Disorders. 38 references. The full text is freely available (open access, CC BY-NC 4.0).
Abstract (original language)
Self‐guided digital mental health apps often show high attrition, highlighting the need to understand engagement beyond behavioural metrics. The Homework Rating Scale—Mobile Application (HRS‐MA) was developed to assess cognitive, emotional and attitudinal aspects of engagement. This study evaluated its psychometric properties. The HRS‐MA was integrated into the MoodMission app and administered after 30 days of use, alongside additional self‐report measures. Data from 2100 users were analysed for reliability, construct, convergent, divergent and predictive validity. The HRS‐MA showed excellent internal consistency (Cronbach's α = 0.90; McDonald's ω = 0.94). Factor analyses supported a two‐factor structure—engagement and difficulty and obstacles. The measure demonstrated strong convergent and divergent validity and modest predictive validity. A derived coefficient of psychological effort, representing the interaction between engagement and perceived barriers, significantly predicted symptom reduction, particularly in depression. The HRS‐MA is a psychometrically sound tool for capturing cognitive and attitudinal dimensions of engagement in digital interventions. It complements behavioural indicators by offering a more comprehensive view of user experience and effort, providing researchers and developers with a valuable framework for optimizing mental health app design and evaluation.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Serra Hunter Fellow, Autonomous University of Barcelona, Barcelona, Spain.
- Department of Clinical Psychology and Psychotherapy, Trier University, Trier, Germany.
- Monash University, Melbourne, Australia.
- University of Tasmania, Hobart, Australia.
- Cognitive Behavior Therapy Network, Adelaide, Australia.
- Beck Institute for Cognitive Behavior Therapy, Philadelphia, Pennsylvania, USA.
ORCID profiles: Danilo Moggia, Wolfgang Lutz, David Bakker, Brian Schwartz, Nikolaos Kazantzis
Cite
APA
Moggia, D., Lutz, W., Bakker, D., Schwartz, B., & Kazantzis, N. (2026). Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy. Clinical Psychology & Psychotherapy. https://doi.org/10.1002/cpp.70239
Vancouver
Moggia D, Lutz W, Bakker D, Schwartz B, Kazantzis N. Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy. Clinical Psychology & Psychotherapy. 2026. doi:10.1002/cpp.70239
BibTeX
@article{Moggia2026,
author = {Moggia, Danilo and Lutz, Wolfgang and Bakker, David and Schwartz, Brian and Kazantzis, Nikolaos},
title = {Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy},
journal = {Clinical Psychology & Psychotherapy},
year = {2026},
doi = {10.1002/cpp.70239}
}
EUVIMED