Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study
JMIR Public Health and Surveillance · 2023-06-16 · 9 · e44465
DOI: 10.2196/44465 ↗At a glance
Beobachtungsstudie in JMIR Public Health and Surveillance, published online on 2023-06-16. Written by Patrick M Archambault and 15 co-authors. Institution: Department of Family Medicine and Emergency Medicine, Université Laval, Québec, QC, Canada. Major MEDLINE topics: COVID-19, Vaccines. Cited 33 times so far (Crossref); 65 references. The full text is freely available in PubMed Central. Funded by: CIHR.
Abstract (original language)
Background
The accuracy of self-reported vaccination status is important to guide real-world vaccine effectiveness studies and policy making in jurisdictions where access to electronic vaccine registries is restricted.
Objective
This study aimed to determine the accuracy of self-reported vaccination status and reliability of the self-reported number of doses, brand, and time of vaccine administration.
Methods
This diagnostic accuracy study was completed by the Canadian COVID-19 Emergency Department Rapid Response Network. We enrolled consecutive patients presenting to 4 emergency departments (EDs) in Québec between March 24, 2020, and December 25, 2021. We included adult patients who were able to consent, could speak English or French, and had a proven COVID-19 infection. We compared the self-reported vaccination status of the patients with their vaccination status in the electronic Québec Vaccination Registry. Our primary outcome was the accuracy of the self-reported vaccination status (index test) ascertained during telephone follow-up compared with the Québec Vaccination Registry (reference standard). The accuracy was calculated by dividing all correctly self-reported vaccinated and unvaccinated participants by the sum of all correctly and incorrectly self-reported vaccinated and unvaccinated participants. We also reported interrater agreement with the reference standard as measured by unweighted Cohen κ for self-reported vaccination status at telephone follow-up and at the time of their index ED visit, number of vaccine doses, and brand.
Results
During the study period, we included 1361 participants. At the time of the follow-up interview, 932 participants reported at least 1 dose of a COVID-19 vaccine. The accuracy of the self-reported vaccination status was 96% (95% CI 95%-97%). Cohen κ for self-reported vaccination status at phone follow-up was 0.91 (95% CI 0.89-0.93) and 0.85 (95% CI 0.77-0.92) at the time of their index ED visit. Cohen κ was 0.89 (95% CI 0.87-0.91) for the number of doses, 0.80 (95% CI 0.75-0.84) for the brand of the first dose, 0.76 (95% CI 0.70-0.83) for the brand of the second dose, and 0.59 (95% CI 0.34-0.83) for the brand of the third dose.
Conclusions
We reported a high accuracy of self-reported vaccination status for adult patients without cognitive disorders who can express themselves in English or French. Researchers can use self-reported COVID-19 vaccination data on the number of doses received, vaccine brand name, and timing of vaccination to guide future research with patients who are capable of self-reporting their vaccination data. However, access to official electronic vaccine registries is still needed to determine the vaccination status in certain susceptible populations where self-reported vaccination data remain missing or impossible to obtain. Trial Registration Clinicaltrials.gov NCT04702945; https://clinicaltrials.gov/ct2/show/NCT04702945
Subjects
MeSH terms (MEDLINE)
Author keywords
Substances
Authors and institutions
- Department of Family Medicine and Emergency Medicine, Université Laval, Québec, QC, Canada.
- Centre de recherche intégrée pour un système de santé apprenant en santé et services sociaux, Centre intégré de santé et services sociaux de Chaudière-Appalaches, Lévis, QC, Canada.
- VITAM - Centre de recherche en santé durable, Québec, QC, Canada.
- Department of Anesthesiology and Intensive Care, Université Laval, Québec, QC, Canada.
- Department of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, AB, Canada.
- Department of Emergency Medicine, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.
ORCID profiles: Patrick M Archambault, Rhonda J Rosychuk, Martyne Audet, Rajan Bola, Shabnam Vatanpour, Steven C Brooks, Raoul Daoust, Gregory Clark, Lars Grant, Samuel Vaillancourt, Michelle Welsford, Laurie J Morrison, Corinne M Hohl
Funding
- CIHR
Cite
APA
Archambault, P. M., Rosychuk, R. J., Audet, M., Bola, R., Vatanpour, S., Brooks, S. C., Daoust, R., Clark, G., Grant, L., Vaillancourt, S., Welsford, M., Morrison, L. J., Hohl, C. M., Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN) investigators, Network of Canadian Emergency Researchers, & Canadian Critical Care Trials Group (2023). Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study. JMIR Public Health and Surveillance, 9, e44465. https://doi.org/10.2196/44465
Vancouver
Archambault PM, Rosychuk RJ, Audet M, Bola R, Vatanpour S, Brooks SC, et al. Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study. JMIR Public Health and Surveillance. 2023;9:e44465. doi:10.2196/44465
BibTeX
@article{Archambault2023,
author = {Archambault, Patrick M and Rosychuk, Rhonda J and Audet, Martyne and Bola, Rajan and Vatanpour, Shabnam and Brooks, Steven C and Daoust, Raoul and Clark, Gregory and Grant, Lars and Vaillancourt, Samuel and Welsford, Michelle and Morrison, Laurie J and Hohl, Corinne M and Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN) investigators, Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN) investigators and Network of Canadian Emergency Researchers, Network of Canadian Emergency Researchers and Canadian Critical Care Trials Group, Canadian Critical Care Trials Group},
title = {Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study},
journal = {JMIR Public Health and Surveillance},
year = {2023},
volume = {9},
pages = {e44465},
doi = {10.2196/44465}
}
EUVIMED