EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Performance of Contradiction Rule Implementations in Health Data for Efficient Data Quality Assessments

Khalid O Yusuf, Irina Chaplinskaya-Sobol, Anne Schoneberg, Sabine Hanss, Sabine Blaschke, Jörg J Vehreschild, Isabel Bröhl, Karin Fiedler, Margarete Scherer, Shimita Sikdar, Patricia Wagner, Ramsia Geisler und 4 weitere

Studies in Health Technology and Informatics · 2025

DOI: 10.3233/shti251410 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2025. Verfasst von Khalid O Yusuf und 15 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Informatics, University Medical Center Göttingen, Germany. Hauptthemen laut MEDLINE: Cardiovascular Diseases, Data Accuracy, Electronic Health Records, Datasets as Topic. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Boolean rules are the building blocks for rule-based data quality assessment (DQA) in health research. While some DQA rules are generic, contradiction rules are guided by established facts supported by domain knowledge. A recent study reported performance degradation in infrastructure as DQA rules scale. Different implementation approaches can be used for DQA rules. In this study, we examine the performance of varied DQA rule implementations for contradictory dependencies in data items for cardiovascular disease assessment and propose an optimization method that integrates the strengths of different approaches.

Methods

We implemented three Boolean rule implementations considered for contradiction assessment of 12 cardiovascular disease items used in the cross-sectoral platform of the national COVID-19 cohort: 1) raw domain rule-set joined using the Boolean-OR operator; 2) two minimal Boolean rules derived from the twelve raw domain rule-set through rule reduction; and 3) atomic Boolean rules representing each rule in the raw domain rule-set. The implementations are examined on speed of execution and memory utilization on the original dataset of about 2000 subjects amplified by factors of 2.5, 5, 10, 50, and 100. A two-step approach is adopted to integrate the implementation of the fastest and atomic contradiction rules.

Results

The raw domain rule-set (1) was more than 100 times faster than the atomic rules (3) and 9 times faster than the minimal Boolean rules (2) with the largest employed dataset. It requires about 3 times more memory than the other implementations. All implementations show linear dependency on the dataset size, except for minimal Boolean rules (2) with a slower slope in memory utilization. Two-step rule processing reduced the speed gap between raw rule-set (1) and atomic rules (3) from 100 times faster to just 3 times in the unified implementation.

Discussion

Only atomic rules (3) support detailed and traceable results for DQA, required for further inspection of the contradictions. A combined rule processing can bridge the speed gap between raw rule-set and atomic rules by executing the fastest rules on entire dataset and atomic rules only on the fraction of data with contradictions, allowing for fast but detailed DQA.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Cardiovascular DiseasesData AccuracyElectronic Health RecordsDatasets as TopicElectronic Data ProcessingHumans

Stichwörter der Autor:innen

Data qualitycontradiction ruleshealth dataincremental processing

Autor:innen und Institutionen

  • Department of Medical Informatics, University Medical Center Göttingen, Germany.
  • German Center for Cardiovascular Research, Partner Site Göttingen, Germany.
  • Emergency Department, University Medical Center Goettingen, Germany.
  • Goethe University Frankfurt, Faculty of Medicine, Institute for Digital Medicine and Clinical Data Science, Germany.
  • University of Würzburg, Institute for Clinical Epidemiology and Biometry.
  • Malteser Krankenhaus St. Franziskus Hospital, Medical Clinic I, Flensburg, Germany.

Zitieren

APA

Yusuf, K. O., Chaplinskaya-Sobol, I., Schoneberg, A., Hanss, S., Blaschke, S., Vehreschild, J. J., Bröhl, I., Fiedler, K., Scherer, M., Sikdar, S., Wagner, P., Geisler, R., Miljukov, O., Milovanovic, M., Reese, J. P., & Krefting, D. (2025). Performance of Contradiction Rule Implementations in Health Data for Efficient Data Quality Assessments. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti251410

Vancouver

Yusuf KO, Chaplinskaya-Sobol I, Schoneberg A, Hanss S, Blaschke S, Vehreschild JJ, et al. Performance of Contradiction Rule Implementations in Health Data for Efficient Data Quality Assessments. Studies in Health Technology and Informatics. 2025. doi:10.3233/shti251410

BibTeX
@article{Yusuf2025,
  author = {Yusuf, Khalid O and Chaplinskaya-Sobol, Irina and Schoneberg, Anne and Hanss, Sabine and Blaschke, Sabine and Vehreschild, Jörg J and Bröhl, Isabel and Fiedler, Karin and Scherer, Margarete and Sikdar, Shimita and Wagner, Patricia and Geisler, Ramsia and Miljukov, Olga and Milovanovic, Milena and Reese, Jens-Peter and Krefting, Dagmar},
  title = {Performance of Contradiction Rule Implementations in Health Data for Efficient Data Quality Assessments},
  journal = {Studies in Health Technology and Informatics},
  year = {2025},
  doi = {10.3233/shti251410}
}
Kostenlos starten →