EUVIMEDEUVIMED entdecken
Mixed-Methods-StudieOpen Access

The Social Construction of Categorical Data: Mixed Methods Approach to Assessing Data Features in Publicly Available Datasets

Theresa Willem iD, Alessandro Wollek iD, Theodor Cheslerean-Boghiu iD, Martha Kenney iD, Alena Buyx iD

JMIR Medical Informatics · 28.01.2025 · 13 · e59452

DOI: 10.2196/59452 ↗

Kurz gefasst

Mixed-Methods-Studie in der Zeitschrift JMIR Medical Informatics, online erschienen am 28.01.2025. Verfasst von Theresa Willem und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of History and Ethics in Medicine, School of Medicine and Health, Technical University of Munich, Munich, Germany. Hauptthemen laut MEDLINE: Machine Learning, Datasets as Topic. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In data-sparse areas such as health care, computer scientists aim to leverage as much available information as possible to increase the accuracy of their machine learning models’ outputs. As a standard, categorical data, such as patients’ gender, socioeconomic status, or skin color, are used to train models in fusion with other data types, such as medical images and text-based medical information. However, the effects of including categorical data features for model training in such data-scarce areas are underexamined, particularly regarding models intended to serve individuals equitably in a diverse population.

Objective

This study aimed to explore categorical data’s effects on machine learning model outputs, rooted the effects in the data collection and dataset publication processes, and proposed a mixed methods approach to examining datasets’ data categories before using them for machine learning training.

Methods

Against the theoretical background of the social construction of categories, we suggest a mixed methods approach to assess categorical data’s utility for machine learning model training. As an example, we applied our approach to a Brazilian dermatological dataset (Dermatological and Surgical Assistance Program at the Federal University of Espírito Santo [PAD-UFES] 20). We first present an exploratory, quantitative study that assesses the effects when including or excluding each of the unique categorical data features of the PAD-UFES 20 dataset for training a transformer-based model using a data fusion algorithm. We then pair our quantitative analysis with a qualitative examination of the data categories based on interviews with the dataset authors.

Results

Our quantitative study suggests scattered effects of including categorical data for machine learning model training across predictive classes. Our qualitative analysis gives insights into how the categorical data were collected and why they were published, explaining some of the quantitative effects that we observed. Our findings highlight the social constructedness of categorical data in publicly available datasets, meaning that the data in a category heavily depend on both how these categories are defined by the dataset creators and the sociomedico context in which the data are collected. This reveals relevant limitations of using publicly available datasets in contexts different from those of the collection of their data.

Conclusions

We caution against using data features of publicly available datasets without reflection on the social construction and context dependency of their categorical data features, particularly in data-sparse areas. We conclude that social scientific, context-dependent analysis of available data features using both quantitative and qualitative methods is helpful in judging the utility of categorical data for the population for which a model is intended.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningDatasets as TopicHumansBrazil

Stichwörter der Autor:innen

categorical datadataset analysisdermatologymachine learningmixed methodssocial context dependency

Autor:innen und Institutionen

  • Institute of History and Ethics in Medicine, School of Medicine and Health, Technical University of Munich, Munich, Germany.
  • Helmholtz AI, Helmholtz Munich, Munich, Germany.
  • Munich Institute of Biomedical Engineering, School of Computation, Information, and Technology, Technical University of Munich, Munich, Germany.
  • Women & Gender Studies, San Francisco State University, San Francisco, CA, United States.

ORCID-Profile: Theresa Willem, Alessandro Wollek, Theodor Cheslerean-Boghiu, Martha Kenney, Alena Buyx

Zitieren

APA

Willem, T., Wollek, A., Cheslerean-Boghiu, T., Kenney, M., & Buyx, A. (2025). The Social Construction of Categorical Data: Mixed Methods Approach to Assessing Data Features in Publicly Available Datasets. JMIR Medical Informatics, 13, e59452. https://doi.org/10.2196/59452

Vancouver

Willem T, Wollek A, Cheslerean-Boghiu T, Kenney M, Buyx A. The Social Construction of Categorical Data: Mixed Methods Approach to Assessing Data Features in Publicly Available Datasets. JMIR Medical Informatics. 2025;13:e59452. doi:10.2196/59452

BibTeX
@article{Willem2025,
  author = {Willem, Theresa and Wollek, Alessandro and Cheslerean-Boghiu, Theodor and Kenney, Martha and Buyx, Alena},
  title = {The Social Construction of Categorical Data: Mixed Methods Approach to Assessing Data Features in Publicly Available Datasets},
  journal = {JMIR Medical Informatics},
  year = {2025},
  volume = {13},
  pages = {e59452},
  doi = {10.2196/59452}
}
Kostenlos starten →