EUVIMEDOpdag EUVIMED
Open access

Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study

Ana Portillo-Van Diest iD, Philippe Mortier iD, Laura Ballester iD, Franco Amigo iD, Paula Carrasco iD, Raquel Falcó iD, Margalida Gili iD, Glenn Kiekens iD, Francisco H Machancoses iD, Jose A Piqueras iD, Marisa Rebagliato iD, Miquel Roca iD and 3 more

Journal of Medical Internet Research · 2024

DOI: 10.2196/55712 ↗

At a glance

Journal article in Journal of Medical Internet Research, 2024. Written by Ana Portillo-Van Diest and 14 co-authors. Institution: Hospital del Mar Research Institute, Barcelona, Spain. Major MEDLINE topics: Students, Ecological Momentary Assessment, Mental Disorders. Cited 21 times so far (Crossref); 79 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

The use of ecological momentary assessment (EMA) designs has been on the rise in mental health epidemiology. However, there is a lack of knowledge of the determinants of participation in and compliance with EMA studies, reliability of measures, and underreporting of methodological details and data quality indicators.

Objective

This study aims to evaluate the quality of EMA data in a large sample of university students by estimating participation rate and mean compliance, identifying predictors of individual-level participation and compliance, evaluating between- and within-person reliability of measures of negative and positive affect, and identifying potential careless responding.

Methods

A total of 1259 university students were invited to participate in a 15-day EMA study on mental health problems. Logistic and Poisson regressions were used to investigate the associations between sociodemographic factors, lifetime adverse experiences, stressful events in the previous 12 months, and mental disorder screens and EMA participation and compliance. Multilevel reliability and intraclass correlation coefficients were obtained for positive and negative affect measures. Careless responders were identified based on low compliance or individual reliability coefficients.

Results

Of those invited, 62.1% (782/1259) participated in the EMA study, with a mean compliance of 76.9% (SD 27.7%). Participation was higher among female individuals (odds ratio [OR] 1.41, 95% CI 1.06-1.87) and lower among those aged ≥30 years (OR 0.20, 95% CI 0.08-0.43 vs those aged 18-21 years) and those who had experienced the death of a friend or family member in the previous 12 months (OR 0.73, 95% CI 0.57-0.94) or had a suicide attempt in the previous 12 months (OR 0.26, 95% CI 0.10-0.64). Compliance was particularly low among those exposed to sexual abuse before the age of 18 years (exponential of β=0.87) or to sexual assault or rape in the previous year (exponential of β=0.80) and among those with 12-month positive alcohol use disorder screens (exponential of β=0.89). Between-person reliability of negative and positive affect was strong (RkRn>0.97), whereas within-person reliability was fair to moderate (Rcn>0.43). Of all answered assessments, 0.86% (291/33,626) were flagged as careless responses because the response time per item was

Subjects

MeSH terms (MEDLINE)

StudentsEcological Momentary AssessmentMental DisordersHumansFemaleMaleUniversitiesYoung AdultAdultMental HealthAdolescentData AccuracyReproducibility of Results

Author keywords

complianceecological momentary assessmentexperience sampling methodmental healthmobile phoneparticipationreliabilitysensitivity analysisuniversity students

Authors and institutions

  • Hospital del Mar Research Institute, Barcelona, Spain.
  • Centro de Investigación Biomédica en Red (CIBER) de Epidemiología y Salud Pública, Instituto de Salud Carlos III, Madrid, Spain.
  • Department of Medicine and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain.
  • Department of Medicine, Science Health Faculty, Universitat Jaume I, Castelló de la Plana, Spain.
  • Epidemiology and Environmental Health Joint Research Unit, Fundació per al Foment de la Investigació Sanitària i Biomèdica de la Comunitat Valenciana (FISABIO)-Universitat Jaume I-Universitat de València, Valencia, Spai…
  • Department of Education Sciences, University of La Rioja, Logroño, Spain.

ORCID profiles: Ana Portillo-Van Diest, Philippe Mortier, Laura Ballester, Franco Amigo, Paula Carrasco, Raquel Falcó, Margalida Gili, Glenn Kiekens, Francisco H Machancoses, Jose A Piqueras, Marisa Rebagliato, Miquel Roca, Tíscar Rodríguez-Jiménez, Jordi Alonso, Gemma Vilagut

Cite

APA

Portillo-Van Diest, A., Mortier, P., Ballester, L., Amigo, F., Carrasco, P., Falcó, R., Gili, M., Kiekens, G., H Machancoses, F., Piqueras, J. A., Rebagliato, M., Roca, M., Rodríguez-Jiménez, T., Alonso, J., & Vilagut, G. (2024). Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study. Journal of Medical Internet Research. https://doi.org/10.2196/55712

Vancouver

Portillo-Van Diest A, Mortier P, Ballester L, Amigo F, Carrasco P, Falcó R, et al. Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study. Journal of Medical Internet Research. 2024. doi:10.2196/55712

BibTeX
@article{PortilloVanDiest2024,
  author = {Portillo-Van Diest, Ana and Mortier, Philippe and Ballester, Laura and Amigo, Franco and Carrasco, Paula and Falcó, Raquel and Gili, Margalida and Kiekens, Glenn and H Machancoses, Francisco and Piqueras, Jose A and Rebagliato, Marisa and Roca, Miquel and Rodríguez-Jiménez, Tíscar and Alonso, Jordi and Vilagut, Gemma},
  title = {Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  doi = {10.2196/55712}
}
Start for free →