EUVIMEDScopri EUVIMED
Open access

Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials

Christian A Webb iD, Lori M Hilt iD, Caroline M Swords iD, Daniel M Bolt iD, Hadar Fisher iD, Simon B Goldberg iD

Journal of Medical Internet Research · 2025-09-09 · 27 · e69297

DOI: 10.2196/69297 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2025-09-09. Written by Christian A Webb and 5 co-authors. Institution: McLean Hospital, Belmont, MA, United States. Major MEDLINE topics: Ecological Momentary Assessment, Mental Health. Cited 12 times so far (Crossref); 114 references. The full text is freely available in PubMed Central. Funded by: NIMH NIH HHS, NCCIH NIH HHS.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Ecological momentary assessment (EMA) is increasingly being incorporated into intervention studies to acquire a more fine-grained and ecologically valid assessment of change. The added utility of including relatively burdensome EMA measures in a clinical trial hinges on several psychometric assumptions, including that these measure are (1) reliable, (2) related to but not redundant with conventional self-report measures (convergent and discriminant validity), (3) sensitive to intervention-related change, and (4) associated with a clinically relevant criterion of improvement (criterion validity) above conventional self-report measures (incremental validity).

Objective

This study aimed to evaluate the reliability, validity, and sensitivity to change of conventional self-report versus EMA measures of rumination improvement.

Methods

We conducted a secondary analysis of data from 4 trials of app-based meditation interventions (N=412). Participants included adolescents (samples 1-2; n=232, 56.3%; aged 12-15 years), college students (sample 3; n=88, 21.4%; aged 18-21 years), and adults (sample 4; n=92, 22.3%; aged 18-80 years). All participants completed validated conventional self-report rumination measures (Children’s Response Styles Questionnaire, Response Styles Questionnaire, or Perseverative Thinking Questionnaire) at baseline and the postintervention time point and EMA rumination assessments throughout 3- to 4-week intervention periods (mean compliance 72.2%-80.2%). We examined the reliability of conventional self-report and EMA measures, computed correlations between measurement approaches, compared rumination improvement using standardized effect sizes, and tested criterion validity by predicting depression symptom improvement.

Results

Reliability of conventional self-report rumination was high at baseline (Cronbach α=0.89-0.94) and the postintervention time point (Cronbach α=0.90-0.95) but decreased for residualized change scores (ρ= 0.71-0.90). EMA rumination showed high mean-level reliability (ρ=0.89-0.96) but substantially lower reliability for change scores (ρ=0.50-0.77). Conventional self-report and EMA measures showed medium correlations at individual time points (r=0.28-0.47; P

Subjects

MeSH terms (MEDLINE)

Ecological Momentary AssessmentMental HealthHumansAdolescentAdultMaleYoung AdultFemaleMiddle AgedAgedChildSelf ReportAged, 80 and overMobile ApplicationsReproducibility of ResultsMeditationPsychometrics

Author keywords

appsecological momentary assessmentmindfulnessreliabilityrumination

Authors and institutions

  • McLean Hospital, Belmont, MA, United States.
  • Harvard Medical School, Boston, MA, United States.
  • Department of Psychology, Lawrence University, Appleton, WI, United States.
  • Center for Healthy Minds and Department of Counseling Psychology, University of Wisconsin-Madison, Madison, WI, United States.
  • Department of Educational Psychology, University of Wisconsin-Madison, Madison, WI, United States.

ORCID profiles: Christian A Webb, Lori M Hilt, Caroline M Swords, Daniel M Bolt, Hadar Fisher, Simon B Goldberg

Funding

  • NIMH NIH HHS
  • NCCIH NIH HHS

Cite

APA

Webb, C. A., Hilt, L. M., Swords, C. M., Bolt, D. M., Fisher, H., & Goldberg, S. B. (2025). Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials. Journal of Medical Internet Research, 27, e69297. https://doi.org/10.2196/69297

Vancouver

Webb CA, Hilt LM, Swords CM, Bolt DM, Fisher H, Goldberg SB. Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials. Journal of Medical Internet Research. 2025;27:e69297. doi:10.2196/69297

BibTeX
@article{Webb2025,
  author = {Webb, Christian A and Hilt, Lori M and Swords, Caroline M and Bolt, Daniel M and Fisher, Hadar and Goldberg, Simon B},
  title = {Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  volume = {27},
  pages = {e69297},
  doi = {10.2196/69297}
}
Start for free →