Machine learning and multianalyte patient-based real-time quality control for simulated chemistry disturbances: Internal evaluation and NHANES-based transportability analysis
Journal of Pathology Informatics · 2026-11 · 100754
DOI: 10.1016/j.jpi.2026.100754 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Pathology Informatics, 2026-11. Verfasst von Sabira Dabeer und 1 weiteren Autor:innen. Die Arbeit nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Introduction
Patient-based real-time quality control (PBRTQC) uses patient results to monitor analytical performance, but performance depends strongly on the disturbance type and monitoring parameters. This study compared a tuned multianalyte moving-average PBRTQC method with logistic regression, Random Forest, and XGBoost for detection of simulated clinical chemistry disturbances and evaluated transportability to independently sourced National Health and Nutrition Examination Survey (NHANES) chemistry profiles. Materials and methods: Independent synthetic training and test cohorts of 10,000 observations each were generated for glucose, sodium, potassium, and creatinine. Error prevalence was 10% in training and 5% in testing. Error-positive observations were assigned to systematic shift, progressive drift, hemolysis-associated, or delayed-processing scenarios. Machine-learning (ML) hyperparameters and classification thresholds were selected using training data only; thresholds were derived from 5-fold out-of-fold predictions. PBRTQC window size and control limit were tuned on the training cohort. Transportability was evaluated using 400 complete NHANES August 2021–August 2023 participant profiles. Each profile was represented under normal, shift, drift, hemolysis, and mixed scenarios. Because the 2000 scenario observations arose from 400 participants, uncertainty for the overall NHANES analysis was estimated by 1000-replicate participant-level cluster bootstrap.
Results
In the independent synthetic test cohort, ROC-AUC was 0.673 for logistic regression, 0.786 for Random Forest, 0.797 for XGBoost, and 0.536 for tuned PBRTQC. Performance varied markedly by disturbance type; for example, hemolysis-associated AUCs were 0.985, 0.978, 0.975, and 0.642, respectively, whereas drift AUCs were 0.643, 0.665, 0.689, and 0.518. In the NHANES-based transportability analysis, overall AUC was 0.886 (95% cluster-bootstrap CI 0.873–0.900) for logistic regression, 0.761 (0.741–0.779) for Random Forest, 0.795 (0.777–0.812) for XGBoost, and 0.807 (0.793–0.823) for PBRTQC. PBRTQC had high sensitivity (0.977) but low specificity (0.079) in the constructed NHANES scenario set.
Conclusions
Detection performance was disturbance-dependent, and no single method was uniformly superior across scenarios. ML models showed stronger internal discrimination for several sample-level perturbations, whereas PBRTQC performed strongly for some NHANES-derived perturbation scenarios but generated many false-positive classifications at the selected operating point. The NHANES analysis should be interpreted as a transportability evaluation using real patient chemistry distributions with computationally imposed disturbances, not as validation against documented real-world quality-control failures.
Zitieren
APA
Dabeer, S., & Palitanawala, H. (2026). Machine learning and multianalyte patient-based real-time quality control for simulated chemistry disturbances: Internal evaluation and NHANES-based transportability analysis. Journal of Pathology Informatics, 100754. https://doi.org/10.1016/j.jpi.2026.100754
Vancouver
Dabeer S, Palitanawala H. Machine learning and multianalyte patient-based real-time quality control for simulated chemistry disturbances: Internal evaluation and NHANES-based transportability analysis. Journal of Pathology Informatics. 2026:100754. doi:10.1016/j.jpi.2026.100754
BibTeX
@article{Dabeer2026,
author = {Dabeer, Sabira and Palitanawala, Hatim},
title = {Machine learning and multianalyte patient-based real-time quality control for simulated chemistry disturbances: Internal evaluation and NHANES-based transportability analysis},
journal = {Journal of Pathology Informatics},
year = {2026},
pages = {100754},
doi = {10.1016/j.jpi.2026.100754}
}
EUVIMED