Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials
Journal of Medical Internet Research · 2025-09-09 · 27 · e69297
DOI: 10.2196/69297 ↗At a glance
Journal article in Journal of Medical Internet Research, published online on 2025-09-09. Written by Christian A Webb and 5 co-authors. Institution: McLean Hospital, Belmont, MA, United States. Major MEDLINE topics: Ecological Momentary Assessment, Mental Health. Cited 12 times so far (Crossref); 114 references. The full text is freely available in PubMed Central. Funded by: NIMH NIH HHS, NCCIH NIH HHS.
Abstract (original language)
Background
Ecological momentary assessment (EMA) is increasingly being incorporated into intervention studies to acquire a more fine-grained and ecologically valid assessment of change. The added utility of including relatively burdensome EMA measures in a clinical trial hinges on several psychometric assumptions, including that these measure are (1) reliable, (2) related to but not redundant with conventional self-report measures (convergent and discriminant validity), (3) sensitive to intervention-related change, and (4) associated with a clinically relevant criterion of improvement (criterion validity) above conventional self-report measures (incremental validity).
Objective
This study aimed to evaluate the reliability, validity, and sensitivity to change of conventional self-report versus EMA measures of rumination improvement.
Methods
We conducted a secondary analysis of data from 4 trials of app-based meditation interventions (N=412). Participants included adolescents (samples 1-2; n=232, 56.3%; aged 12-15 years), college students (sample 3; n=88, 21.4%; aged 18-21 years), and adults (sample 4; n=92, 22.3%; aged 18-80 years). All participants completed validated conventional self-report rumination measures (Children’s Response Styles Questionnaire, Response Styles Questionnaire, or Perseverative Thinking Questionnaire) at baseline and the postintervention time point and EMA rumination assessments throughout 3- to 4-week intervention periods (mean compliance 72.2%-80.2%). We examined the reliability of conventional self-report and EMA measures, computed correlations between measurement approaches, compared rumination improvement using standardized effect sizes, and tested criterion validity by predicting depression symptom improvement.
Results
Reliability of conventional self-report rumination was high at baseline (Cronbach α=0.89-0.94) and the postintervention time point (Cronbach α=0.90-0.95) but decreased for residualized change scores (ρ= 0.71-0.90). EMA rumination showed high mean-level reliability (ρ=0.89-0.96) but substantially lower reliability for change scores (ρ=0.50-0.77). Conventional self-report and EMA measures showed medium correlations at individual time points (r=0.28-0.47; P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- McLean Hospital, Belmont, MA, United States.
- Harvard Medical School, Boston, MA, United States.
- Department of Psychology, Lawrence University, Appleton, WI, United States.
- Center for Healthy Minds and Department of Counseling Psychology, University of Wisconsin-Madison, Madison, WI, United States.
- Department of Educational Psychology, University of Wisconsin-Madison, Madison, WI, United States.
ORCID profiles: Christian A Webb, Lori M Hilt, Caroline M Swords, Daniel M Bolt, Hadar Fisher, Simon B Goldberg
Funding
- NIMH NIH HHS
- NCCIH NIH HHS
Cite
APA
Webb, C. A., Hilt, L. M., Swords, C. M., Bolt, D. M., Fisher, H., & Goldberg, S. B. (2025). Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials. Journal of Medical Internet Research, 27, e69297. https://doi.org/10.2196/69297
Vancouver
Webb CA, Hilt LM, Swords CM, Bolt DM, Fisher H, Goldberg SB. Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials. Journal of Medical Internet Research. 2025;27:e69297. doi:10.2196/69297
BibTeX
@article{Webb2025,
author = {Webb, Christian A and Hilt, Lori M and Swords, Caroline M and Bolt, Daniel M and Fisher, Hadar and Goldberg, Simon B},
title = {Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e69297},
doi = {10.2196/69297}
}
EUVIMED