Creating an Empirical Dermatology Dataset Through Crowdsourcing With Web Search Advertisements
JAMA Network Open · 20.11.2024 · 7 (11) · e2446615
DOI: 10.1001/jamanetworkopen.2024.46615 ↗Kurz gefasst
Beobachtungsstudie in der Zeitschrift JAMA Network Open, online erschienen am 20.11.2024. Verfasst von Abbi Ward und 20 weiteren Autor:innen. Beteiligte Einrichtung: Google Research, Mountain View, California. Hauptthemen laut MEDLINE: Crowdsourcing, Internet, Advertising. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Importance Health datasets from clinical sources do not reflect the breadth and diversity of disease, impacting research, medical education, and artificial intelligence tool development. Assessments of novel crowdsourcing methods to create health datasets are needed.
Objective
To evaluate if web search advertisements (ads) are effective at creating a diverse and representative dermatology image dataset. Design, Setting, and Participants This prospective observational survey study, conducted from March to November 2023, used Google Search ads to invite internet users in the US to contribute images of dermatology conditions with demographic and symptom information to the Skin Condition Image Network (SCIN) open access dataset. Ads were displayed against dermatology-related search queries on mobile devices, inviting contributions from adults after a digital informed consent process. Contributions were filtered for image safety and measures were taken to protect privacy. Data analysis occurred January to February 2024. Exposure Dermatologist condition labels as well as estimated Fitzpatrick Skin Type (eFST) and estimated Monk Skin Tone (eMST) labels. Main Outcomes and Measures The primary metrics of interest were the number, quality, demographic diversity, and distribution of clinical conditions in the crowdsourced contributions. Spearman rank order correlation was used for all correlation analyses, and the χ 2 test was used to analyze differences between SCIN contributor demographics and the US census.
Results
In total, 5749 submissions were received, with a median of 22 (14-30) per day. Of these, 5631 (97.9%) were genuine images of dermatological conditions. Among contributors with self-reported demographic information, female contributors (1732 of 2596 contributors [66.7%]) and younger contributors (1329 of 2556 contributors [52.0%] aged <40 years) had a higher representation in the dataset compared with the US population. Of 2614 contributors who reported race and ethnicity, 852 (32.6%) reported a racial or ethnic identity other than White. Dermatologist confidence in assigning a differential diagnosis increased with the number of self-reported demographic and skin-condition–related variables (Spearman R = 0.1537; P < .001). Of 4019 contributions reporting duration since onset, 2170 (54.0%) reported onset within less than 7 days of submission. Of the 2835 contributions that could be assigned a dermatological differential diagnosis, 2523 (89.0%) were allergic, infectious, or inflammatory conditions. eFST and eMST distributions reflected the geographical origin of the dataset. Conclusions and Relevance The findings of this survey study suggest that search ads are effective at crowdsourcing dermatology images and could therefore be a useful method to create health datasets. The SCIN dataset bridges important gaps in the availability of images of common, short-duration skin conditions.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Google Research, Mountain View, California.
- Google Research, Bengaluru, India.
- Stanford Healthcare AI Applied Research Team, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California.
- Department of Dermatology, Stanford University School of Medicine, Stanford California.
- Google Research, London, UK.
- Google Research, Amsterdam, Netherlands.
Zitieren
APA
Ward, A., Li, J., Wang, J., Lakshminarasimhan, S., Carrick, A., Campana, B., Hartford, J., Sreenivasaiah, P. K., Tiyasirisokchai, T., Virmani, S., Wong, R., Matias, Y., Corrado, G. S., Webster, D. R., Smith, M. A., Siegel, D., Lin, S., Ko, J., Karthikesalingam, A., …, & Rao, P. (2024). Creating an Empirical Dermatology Dataset Through Crowdsourcing With Web Search Advertisements. JAMA Network Open, 7(11), e2446615. https://doi.org/10.1001/jamanetworkopen.2024.46615
Vancouver
Ward A, Li J, Wang J, Lakshminarasimhan S, Carrick A, Campana B, et al. Creating an Empirical Dermatology Dataset Through Crowdsourcing With Web Search Advertisements. JAMA Network Open. 2024;7(11):e2446615. doi:10.1001/jamanetworkopen.2024.46615
BibTeX
@article{Ward2024,
author = {Ward, Abbi and Li, Jimmy and Wang, Julie and Lakshminarasimhan, Sriram and Carrick, Ashley and Campana, Bilson and Hartford, Jay and Sreenivasaiah, Pradeep K and Tiyasirisokchai, Tiya and Virmani, Sunny and Wong, Renee and Matias, Yossi and Corrado, Greg S and Webster, Dale R and Smith, Margaret Ann and Siegel, Dawn and Lin, Steven and Ko, Justin and Karthikesalingam, Alan and Semturs, Christopher and Rao, Pooja},
title = {Creating an Empirical Dermatology Dataset Through Crowdsourcing With Web Search Advertisements},
journal = {JAMA Network Open},
year = {2024},
volume = {7},
number = {11},
pages = {e2446615},
doi = {10.1001/jamanetworkopen.2024.46615}
}
EUVIMED