Adaptation, calibration, and validation of a cognitive assessment battery for telephone and video administration
Journal of the American Geriatrics Society · 2025-02 · 73 (2) · 482-491
DOI: 10.1111/jgs.19275 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift Journal of the American Geriatrics Society, online erschienen am 21.11.2024. Verfasst von Yonah Joffe und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Clinical and Health Psychology, University of Florida College of Public Health and Health Professions, Gainesville, Florida, USA. Hauptthemen laut MEDLINE: Telephone, Neuropsychological Tests, Videoconferencing. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Institutes of Health, National Institute on Aging, NIA NIH HHS, National Institutes of Health.
Abstract (Originalsprache)
Background
Events such as global pandemics can force rapid adoption of new modes of assessment. We describe the evaluation of a modified neuropsychological assessment for web and telephone administration.
Methods
Telephone and video conferencing‐based neuropsychological assessment procedures were developed and implemented within an ongoing observational study, the Successful Aging following Elective Surgery II (SAGES) study ( N = 420 persons). Repeated cognitive assessments were used ( N = 2008 observations). Analyses using latent variable psychometric methods were used to compare the measurement modes, and a nested validation sub‐study ( N = 100 persons) was used to test for measurement equivalence. We used item response theory methods to calibrate data collected by different assessment modes. Measurement equivalence was assessed with Bland–Altman plots and regression analysis.
Results
Only small differences were detected between in‐person and video modes of assessment. The largest difference among factor loadings was shared for the Boston Naming Test and Visual Search and attention test, but the effects were very small (Cohen's q = 0.06) and not statistically significant (95% confidence interval on q , −0.06, +0.18). In terms of item difficulty differences between in‐person and video, the Digit Span Backwards test was less difficult by video with a small‐to‐moderate effect size (Cohen's d of −0.28, 95% CI, −0.54, −0.01). The contrast of in‐person and telephone assessment was larger, with telephone assessment being less difficult than in‐person (largest shift in item difficulty for digit span backwards, d = −1.12 95% CI −1.35, −0.90). Calibrated scores from telephone and videoconference demonstrated good agreement ( r = 0.72, 95% CI 0.61, 0.80), and the differences could be corrected with latent variable measurement models.
Conclusions
Videoconference based neuropsychological assessment can be as precise as in‐person. Calibration of ability estimates using latent variable measurement models can address measurement differences and generate scores without evidence of systematic bias.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Clinical and Health Psychology, University of Florida College of Public Health and Health Professions, Gainesville, Florida, USA.
- University of Rochester Medical Center, Rochester, New York, USA.
- Department of Psychiatry and Human Behavior, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA.
- Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School and Aging Brain Center, Marcus Institute for Aging Research, Hebrew SeniorLife, Boston, Massachusetts, USA.
- Hebrew SeniorLife, Marcus Institute for Aging Research, Boston, Massachusetts, USA.
- Aging Brain Center, Marcus Institute for Aging Research, Hebrew SeniorLife, Boston, Massachusetts, USA.
ORCID-Profile: Yonah Joffe, Franchesca Arias, Zachary J Kunicki, Richard N Jones
Förderung
- National Institutes of Health, National Institute on Aging
- NIA NIH HHS
- National Institutes of Health
Zitieren
APA
Joffe, Y., Liu, J., Arias, F., Tommet, D., Fong, T. G., Schmitt, E. M., Travison, T., Kunicki, Z. J., Inouye, S. K., & Jones, R. N. (2025). Adaptation, calibration, and validation of a cognitive assessment battery for telephone and video administration. Journal of the American Geriatrics Society, 73(2), 482-491. https://doi.org/10.1111/jgs.19275
Vancouver
Joffe Y, Liu J, Arias F, Tommet D, Fong TG, Schmitt EM, et al. Adaptation, calibration, and validation of a cognitive assessment battery for telephone and video administration. Journal of the American Geriatrics Society. 2025;73(2):482-491. doi:10.1111/jgs.19275
BibTeX
@article{Joffe2025,
author = {Joffe, Yonah and Liu, Julianna and Arias, Franchesca and Tommet, Douglas and Fong, Tamara G and Schmitt, Eva M and Travison, Thomas and Kunicki, Zachary J and Inouye, Sharon K and Jones, Richard N},
title = {Adaptation, calibration, and validation of a cognitive assessment battery for telephone and video administration},
journal = {Journal of the American Geriatrics Society},
year = {2025},
volume = {73},
number = {2},
pages = {482--491},
doi = {10.1111/jgs.19275}
}
EUVIMED