Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration
JAMA Network Open · 01.04.2024 · 7 (4) · e244266
DOI: 10.1001/jamanetworkopen.2024.4266 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 01.04.2024. Verfasst von Adam M Staffaroni und 50 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neurology, Memory and Aging Center, Weill Institute for Neurosciences, University of California, San Francisco. Hauptthemen laut MEDLINE: Frontotemporal Dementia, Frontotemporal Lobar Degeneration. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIA NIH HHS, NINDS NIH HHS, NIMH NIH HHS.
Abstract (Originalsprache)
Importance Frontotemporal lobar degeneration (FTLD) is relatively rare, behavioral and motor symptoms increase travel burden, and standard neuropsychological tests are not sensitive to early-stage disease. Remote smartphone-based cognitive assessments could mitigate these barriers to trial recruitment and success, but no such tools are validated for FTLD.
Objective
To evaluate the reliability and validity of smartphone-based cognitive measures for remote FTLD evaluations. Design, Setting, and Participants In this cohort study conducted from January 10, 2019, to July 31, 2023, controls and participants with FTLD performed smartphone application (app)–based executive functioning tasks and an associative memory task 3 times over 2 weeks. Observational research participants were enrolled through 18 centers of a North American FTLD research consortium (ALLFTD) and were asked to complete the tests remotely using their own smartphones. Of 1163 eligible individuals (enrolled in parent studies), 360 were enrolled in the present study; 364 refused and 439 were excluded. Participants were divided into discovery (n = 258) and validation (n = 102) cohorts. Among 329 participants with data available on disease stage, 195 were asymptomatic or had preclinical FTLD (59.3%), 66 had prodromal FTLD (20.1%), and 68 had symptomatic FTLD (20.7%) with a range of clinical syndromes. Exposure Participants completed standard in-clinic measures and remotely administered ALLFTD mobile app (app) smartphone tests. Main Outcomes and Measures Internal consistency, test-retest reliability, association of smartphone tests with criterion standard clinical measures, and diagnostic accuracy.
Results
In the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Validity was supported by association of smartphones tests with disease severity ( r range, 0.38-0.59), criterion-standard neuropsychological tests ( r range, 0.40-0.66), and brain volume (standardized β range, 0.34-0.50). Smartphone tests accurately differentiated individuals with dementia from controls (area under the curve [AUC], 0.93 [95% CI, 0.90-0.96]) and were more sensitive to early symptoms (AUC, 0.82 [95% CI, 0.76-0.88]) than the Montreal Cognitive Assessment (AUC, 0.68 [95% CI, 0.59-0.78]) ( z of comparison, −2.49 [95% CI, −0.19 to −0.02]; P = .01). Reliability and validity findings were highly similar in the discovery and validation cohorts. Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = −0.49 [95% CI, −0.72 to −0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = −0.14 [95% CI, −0.42 to 0.14]; P = .32). Conclusions and Relevance The findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Smartphone assessments should be considered as a complementary approach to traditional in-person trial designs. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Neurology, Memory and Aging Center, Weill Institute for Neurosciences, University of California, San Francisco.
- Department of Neurology, Columbia University, New York, New York.
- Department of Neurology, Mayo Clinic, Rochester, Minnesota.
- Department of Quantitative Health Sciences, Division of Biomedical Statistics and Informatics, Mayo Clinic, Rochester, Minnesota.
- Department of Neurology, Case Western Reserve University, Cleveland, Ohio.
- Department of Neurosciences, University of California, San Diego, La Jolla.
Förderung
- NIA NIH HHS
- NINDS NIH HHS
- NIMH NIH HHS
Zitieren
APA
Staffaroni, A. M., Clark, A. L., Taylor, J. C., Heuer, H. W., Sanderson-Cimino, M., Wise, A. B., Dhanam, S., Cobigo, Y., Wolf, A., Manoochehri, M., Forsberg, L., Mester, C., Rankin, K. P., Appleby, B. S., Bayram, E., Bozoki, A., Clark, D., Darby, R. R., Domoto-Reilly, K., …, & ALLFTD Consortium (2024). Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration. JAMA Network Open, 7(4), e244266. https://doi.org/10.1001/jamanetworkopen.2024.4266
Vancouver
Staffaroni AM, Clark AL, Taylor JC, Heuer HW, Sanderson-Cimino M, Wise AB, et al. Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration. JAMA Network Open. 2024;7(4):e244266. doi:10.1001/jamanetworkopen.2024.4266
BibTeX
@article{Staffaroni2024,
author = {Staffaroni, Adam M and Clark, Annie L and Taylor, Jack C and Heuer, Hilary W and Sanderson-Cimino, Mark and Wise, Amy B and Dhanam, Sreya and Cobigo, Yann and Wolf, Amy and Manoochehri, Masood and Forsberg, Leah and Mester, Carly and Rankin, Katherine P and Appleby, Brian S and Bayram, Ece and Bozoki, Andrea and Clark, David and Darby, R Ryan and Domoto-Reilly, Kimiko and Fields, Julie A and Galasko, Douglas and Geschwind, Daniel and Ghoshal, Nupur and Graff-Radford, Neill and Grossman, Murray and Hsiung, Ging-Yuek and Huey, Edward D and Jones, David T and Lapid, Maria I and Litvan, Irene and Masdeu, Joseph C and Massimo, Lauren and Mendez, Mario F and Miyagawa, Toji and Pascual, Belen and Pressman, Peter and Ramanan, Vijay K and Ramos, Eliana Marisa and Rascovsky, Katya and Roberson, Erik D and Tartaglia, M Carmela and Wong, Bonnie and Miller, Bruce L and Kornak, John and Kremers, Walter and Hassenstab, Jason and Kramer, Joel H and Boeve, Bradley F and Rosen, Howard J and Boxer, Adam L and ALLFTD Consortium, ALLFTD Consortium},
title = {Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration},
journal = {JAMA Network Open},
year = {2024},
volume = {7},
number = {4},
pages = {e244266},
doi = {10.1001/jamanetworkopen.2024.4266}
}
EUVIMED