EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A visual analytic method to investigate patterns and structures of missing data

Roy A Ruddle iD

PLOS One · 07.08.2026 · 21 (8) · e0355400

DOI: 10.1371/journal.pone.0355400 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 07.08.2026. Verfasst von Roy A Ruddle. Beteiligte Einrichtung: School of Computer Science, University of Leeds, Leeds, United Kingdom. Hauptthemen laut MEDLINE: Data Accuracy. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Engineering and Physical Sciences Research Council, Alan Turing Institute.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Datasets often have missing values. Understanding the locations and underlying reasons (missing data patterns and structures, respectively) is important to avoid analysis bias or building inappropriate models. However, investigating missing data patterns and structures presents significant challenges. To address them we developed a novel visual analytic method, which combines new purity metrics for three core types of pattern (block, monotone and disjoint) with seven different visualizations in an iterative workflow. We also conducted two case studies, one with a UCI Machine Learning Repository dataset and the other with a 21 million record/389 variable hospital dataset that had many interwoven missingness patterns. In the UCI case study, the method’s purity metrics and heatmaps revealed a rare data quality issue that affected 0.08% of records, but was not apparent when an existing correlation-based approach was used. Our method also implements perceptual discontinuity to ensure that small values are visible in bar charts, and that showed that two variables were missing values in 0.02% and 0.3% of records, respectively, rather than being complete as reported in the original UCI paper. The hospital dataset contained 595,171 unique combinations of missing values, but that overwhelming number was reduced to 57 comprehensible patterns by iteratively using purity metrics and heatmaps with the three core pattern types in our method. That revealed insights that ranged from uncovering rare and common data quality issues, to finding data dictionary errors, and making explicit relationships between groups of variables that may otherwise be hidden. The method also provides an explanation graph, which aids reproducibility by documenting the order in which patterns were found and acts as a tangible artifact that should help communicate the findings to stakeholders.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data AccuracyHumansMachine Learning

Autor:innen und Institutionen

  • School of Computer Science, University of Leeds, Leeds, United Kingdom.
  • Leeds Institute for Data Analytics, University of Leeds, Leeds, United Kingdom.

ORCID-Profile: Roy A Ruddle

Förderung

  • Engineering and Physical Sciences Research Council
  • Alan Turing Institute

Zitieren

APA

Ruddle, R. A. (2026). A visual analytic method to investigate patterns and structures of missing data. PLOS One, 21(8), e0355400. https://doi.org/10.1371/journal.pone.0355400

Vancouver

Ruddle RA. A visual analytic method to investigate patterns and structures of missing data. PLOS One. 2026;21(8):e0355400. doi:10.1371/journal.pone.0355400

BibTeX
@article{Ruddle2026,
  author = {Ruddle, Roy A},
  title = {A visual analytic method to investigate patterns and structures of missing data},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {8},
  pages = {e0355400},
  doi = {10.1371/journal.pone.0355400}
}
Kostenlos starten →