EUVIMEDObjevte EUVIMED
Open access

Measuring the Quality of Datasets: Development of the IDEFIM Indicator Set for Empirical Health Research

Sonja Harkener, Oliver J Bott, Christian Draeger, Tobias Hartz, Ekkehart Jenetzky, Matthias Löbe, Stefanie March, Chris Schubert, Jürgen Stausberg

Journal of Medical Internet Research · 2026-06-17 · 28 · e90482-e90482

DOI: 10.2196/90482 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2026-06-17. Written by Sonja Harkener and 8 co-authors. Institution: Institute for Medical Informatics, Biometry and Epidemiology, Faculty of Medicine, University of Duisburg-Essen, Hufelandstr. 55, Essen, North Rhine-…. Major MEDLINE topics: Data Accuracy, Empirical Research. 47 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

To be beneficial for empirical health research, a dataset must be fit for use. The quality of a dataset can only be influenced during data collection, yet it is evaluated multiple times during analysis or secondary use by applying quality indicators.

Objective

This study aimed to establish an up-to-date set of indicators measuring the quality of datasets in empirical health research.

Methods

A total of 3 pillars were combined. First, the 51 indicators of a German guideline from 2014 about the management of data quality were revised. Second, a literature review was performed looking for evidence sources since 2013 that describe, propose, or apply dataset quality indicators. Third, indicators were supplemented by a manual search and other sources. The quality indicators were then integrated into the IDEFIM framework. The IDEFIM framework distinguishes between the categories’ data, metadata, context, and openness quality. In this work, only the categories data and metadata quality, with their 14 dimensions were considered.

Results

In total, 69 indicators qualified for the IDEFIM indicator set, 53 related to the category data quality, and 16 to the category metadata quality. A total of 30 indicators originated from the German guideline, 31 from the literature review. Three indicators were added to cover aspects of diversity, equity, and inclusion, and an additional 5 related to specifics of data and metadata quality not addressed so far. Most indicators were found in the dimensions accuracy (data) with 12 measures, completeness (data) with 12 measures, and consistency (data) with 19 measures. According to the number of supporting evidence sources, missing values in data elements (48 evidence sources), contradictions (31), and currentness (26) were the most popular quality indicators. Metadata quality was significantly less frequently addressed.

Conclusions

The presented IDEFIM indicator set can be used for the management of data collections as well as for the verification of a dataset’s quality for an intended use. The indicator set should also be considered in the design of a study in empirical health research and the development of software tools supporting the visualization of issues related to the quality of a dataset.

Subjects

MeSH terms (MEDLINE)

Data AccuracyEmpirical ResearchGermanyHumansMetadata

Author keywords

IDEFIM frameworkdata qualitydatasetempirical health researchhealth caremetadataquality indicatorsecondary use

Authors and institutions

  • Institute for Medical Informatics, Biometry and Epidemiology, Faculty of Medicine, University of Duisburg-Essen, Hufelandstr. 55, Essen, North Rhine-Westphalia, 45122, Germany, 49 201 72377201.
  • Institute for Applied Data Science Hannover (DATA|H), Hochschule Hannover - University of Applied Sciences and Arts, Hannover, Lower Saxony, Germany.
  • Institute for Medical Informatics, Statistics and Epidemiology, University of Leipzig, Leipzig, Saxony, Germany.
  • Clinical Cancer Registry Lower Saxony, Hannover, Germany.
  • Faculty of Health/School of Medicine, Witten/Herdecke University, Witten, North Rhine-Westphalia, Germany.
  • University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Rhineland-Palatinate, Germany.

Cite

APA

Harkener, S., Bott, O. J., Draeger, C., Hartz, T., Jenetzky, E., Löbe, M., March, S., Schubert, C., & Stausberg, J. (2026). Measuring the Quality of Datasets: Development of the IDEFIM Indicator Set for Empirical Health Research. Journal of Medical Internet Research, 28, e90482-e90482. https://doi.org/10.2196/90482

Vancouver

Harkener S, Bott OJ, Draeger C, Hartz T, Jenetzky E, Löbe M, et al. Measuring the Quality of Datasets: Development of the IDEFIM Indicator Set for Empirical Health Research. Journal of Medical Internet Research. 2026;28:e90482-e90482. doi:10.2196/90482

BibTeX
@article{Harkener2026,
  author = {Harkener, Sonja and Bott, Oliver J and Draeger, Christian and Hartz, Tobias and Jenetzky, Ekkehart and Löbe, Matthias and March, Stefanie and Schubert, Chris and Stausberg, Jürgen},
  title = {Measuring the Quality of Datasets: Development of the IDEFIM Indicator Set for Empirical Health Research},
  journal = {Journal of Medical Internet Research},
  year = {2026},
  volume = {28},
  pages = {e90482--e90482},
  doi = {10.2196/90482}
}
Start for free →