EUVIMEDTutustu EUVIMEDiin
Open access · CC BY-NC 4.0

Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy

Danilo Moggia iD, Wolfgang Lutz iD, David Bakker iD, Brian Schwartz iD, Nikolaos Kazantzis iD

Clinical Psychology & Psychotherapy · 2026

DOI: 10.1002/cpp.70239 ↗

At a glance

Journal article in Clinical Psychology & Psychotherapy, 2026. Written by Danilo Moggia and 4 co-authors. Institution: Serra Hunter Fellow, Autonomous University of Barcelona, Barcelona, Spain. Major MEDLINE topics: Cognitive Behavioral Therapy, Mobile Applications, Smartphone, Mental Disorders. 38 references. The full text is freely available (open access, CC BY-NC 4.0).

TiivistelmäSubjectsBibliografiset tiedotCiteRelated studies

Abstract (original language)

Self‐guided digital mental health apps often show high attrition, highlighting the need to understand engagement beyond behavioural metrics. The Homework Rating Scale—Mobile Application (HRS‐MA) was developed to assess cognitive, emotional and attitudinal aspects of engagement. This study evaluated its psychometric properties. The HRS‐MA was integrated into the MoodMission app and administered after 30 days of use, alongside additional self‐report measures. Data from 2100 users were analysed for reliability, construct, convergent, divergent and predictive validity. The HRS‐MA showed excellent internal consistency (Cronbach's α = 0.90; McDonald's ω = 0.94). Factor analyses supported a two‐factor structure—engagement and difficulty and obstacles. The measure demonstrated strong convergent and divergent validity and modest predictive validity. A derived coefficient of psychological effort, representing the interaction between engagement and perceived barriers, significantly predicted symptom reduction, particularly in depression. The HRS‐MA is a psychometrically sound tool for capturing cognitive and attitudinal dimensions of engagement in digital interventions. It complements behavioural indicators by offering a more comprehensive view of user experience and effort, providing researchers and developers with a valuable framework for optimizing mental health app design and evaluation.

Subjects

MeSH terms (MEDLINE)

Cognitive Behavioral TherapyMobile ApplicationsSmartphoneMental DisordersHumansPsychometricsReproducibility of ResultsFemaleMaleAdultMiddle AgedDigital Health

Author keywords

digital interventionsdigital mental healthe‐healthself‐guided interventions

Authors and institutions

  • Serra Hunter Fellow, Autonomous University of Barcelona, Barcelona, Spain.
  • Department of Clinical Psychology and Psychotherapy, Trier University, Trier, Germany.
  • Monash University, Melbourne, Australia.
  • University of Tasmania, Hobart, Australia.
  • Cognitive Behavior Therapy Network, Adelaide, Australia.
  • Beck Institute for Cognitive Behavior Therapy, Philadelphia, Pennsylvania, USA.

ORCID profiles: Danilo Moggia, Wolfgang Lutz, David Bakker, Brian Schwartz, Nikolaos Kazantzis

Cite

APA

Moggia, D., Lutz, W., Bakker, D., Schwartz, B., & Kazantzis, N. (2026). Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy. Clinical Psychology & Psychotherapy. https://doi.org/10.1002/cpp.70239

Vancouver

Moggia D, Lutz W, Bakker D, Schwartz B, Kazantzis N. Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy. Clinical Psychology & Psychotherapy. 2026. doi:10.1002/cpp.70239

BibTeX
@article{Moggia2026,
  author = {Moggia, Danilo and Lutz, Wolfgang and Bakker, David and Schwartz, Brian and Kazantzis, Nikolaos},
  title = {Psychometric Evaluation of the Homework Rating Scale—Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone‐Delivered Cognitive Behavioural Therapy},
  journal = {Clinical Psychology & Psychotherapy},
  year = {2026},
  doi = {10.1002/cpp.70239}
}
Start for free →