Attrition and representativeness in development and validation of online symptom checkers—a case study on the Rheumatic? Questionnaire
Frontiers in Artificial Intelligence · 08.05.2026 · 9
DOI: 10.3389/frai.2026.1815241 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Artificial Intelligence, online erschienen am 08.05.2026. Verfasst von Floor Dijkstra Zegers und 15 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, Netherlands. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Online symptom checkers are often developed and validated on data subject to self-selection and selective attrition, potentially introducing biases in prediction models.
Objectives
To assess recruitment, selection, and attrition patterns in a large Dutch online symptom checker for musculoskeletal complaints and to evaluate potential biases by comparing participant characteristics across recruitment sources and with external target populations.
Methods
Using data from the online Dutch Rheumatic ? Questionnaire on musculoskeletal complaints, we compared baseline characteristics and key self-reported symptoms between responders to the follow-up survey and nonresponders. The survey responders were furthermore compared according to source of recruitment to the questionnaire, i.e., via primary care clinics, secondary care clinics, or via different online sources. Sex, age and BMI distributions from the total study group were compared to external data of potential target populations of primary and secondary care patients within the Netherlands.
Results
The total study group of answers to the questionnaire comprised 31,457 responders, of which 50% ( n = 15,591) responded to the follow-up survey. Study participants were predominantly female (76%), middle-aged (one-third 50–60 years), never-smokers (66%), and overweight. While participants recruited through healthcare settings resembled target populations, follow-up survey responders were older, had more rheumatic diagnoses (49% vs. 32%), and reported more symptoms than non-responders. Participant characteristics varied by recruitment source, with social media attracting younger females while healthcare routes reached more diverse populations with varying symptom presentations.
Conclusion
Patterns of recruitment and attrition produced differences in participant characteristics. Healthcare-based recruitment yielded participants resembling intended target populations, and follow-up survey responders differed on some points from nonresponders. Awareness of these selection processes is essential when using real-world symptom checker data for model development.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, Netherlands.
- Department of Rheumatology, Leiden University Medical Center, Leiden, Netherlands.
- Department of Intelligent Systems, Pattern Recognition and Bioinformatics, Delft University of Technology, Delft, Netherlands.
- Reumazorg Zuid-West Nederland, Roosendaal, Netherlands.
- Department of Rheumatology, Maastricht University Medical Centre+, Maastricht, Netherlands.
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, Netherlands.
Zitieren
APA
Zegers, F. D., Qin, L., Selani, D., Gomon, G., Maarseveen, T., Glas, K., van Tubergen, A., Ruiterman, Y. G., Reinders, M., van den Akker, E., de Jong, C. B., Klareskog, L., Axnäs, B., Bos, R., le Cessie, S., & Knevel, R. (2026). Attrition and representativeness in development and validation of online symptom checkers—a case study on the Rheumatic? Questionnaire. Frontiers in Artificial Intelligence, 9. https://doi.org/10.3389/frai.2026.1815241
Vancouver
Zegers FD, Qin L, Selani D, Gomon G, Maarseveen T, Glas K, et al. Attrition and representativeness in development and validation of online symptom checkers—a case study on the Rheumatic? Questionnaire. Frontiers in Artificial Intelligence. 2026;9. doi:10.3389/frai.2026.1815241
BibTeX
@article{Zegers2026,
author = {Zegers, Floor Dijkstra and Qin, Ling and Selani, Daniyal and Gomon, Georgy and Maarseveen, Tjardo and Glas, Kasper and van Tubergen, Astrid and Ruiterman, Yvonne Goekoop and Reinders, Marcel and van den Akker, Erik and de Jong, Corne Baatenburg and Klareskog, Lars and Axnäs, Barbara and Bos, Reinhard and le Cessie, Saskia and Knevel, Rachel},
title = {Attrition and representativeness in development and validation of online symptom checkers—a case study on the Rheumatic? Questionnaire},
journal = {Frontiers in Artificial Intelligence},
year = {2026},
volume = {9},
doi = {10.3389/frai.2026.1815241}
}
EUVIMED