EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Precision-Aware Workload Analytics for AI Systems: A Unified Monitoring Framework Across PyTorch and Scikit-learn Pipelines

Haoran Liu, Marco Bianchi, Yuki Tanaka

DATAMIND · 30.06.2025 · 3 (2) · 5-19

DOI: 10.63646/datamind.2025.030202 ↗

Kurz gefasst

Fachartikel in der Zeitschrift DATAMIND, online erschienen am 30.06.2025. Verfasst von Haoran Liu und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The computational cost of modern machine-learning (ML) and deep-learning (DL) workloads has become a first-class concern in applied AI research, particularly as workloads grow in size and as hardware diversity widens. Conventional efficiency indicators such as wall-clock time, joules, or equivalent CO2 emissions depend strongly on the physical machine on which an experiment is executed, which makes reproducible comparison across laboratories and across hardware generations difficult. This paper develops a unified monitoring framework that measures computational workload at two complementary levels: the algorithmic level, captured by floating-point-operation (FLOP) counts, and the hardware-level, captured by bit-operation (BOP) counts that incorporate operand precision. The framework is implemented as a hardware-agnostic, backend-pluggable Python pipeline that intercepts operations dynamically in PyTorch through the dispatcher layer and wraps estimator methods analytically in Scikit-learn. Using a structured evaluation across three canonical workloads—a fully-connected classifier on tabular data, a convolutional model on image data, and a small transformer on text—we show that FLOP counts alone systematically mis-represent the efficiency benefits of quantization, while BOP counts provide a more faithful view of hardware-level effort. Aggregation over training and inference phases, combined with precision-aware scaling, yields a reproducible efficiency fingerprint that is stable across CPU and GPU backends to within a narrow interval. The framework preserves the structure of existing experimental pipelines and adds only a thin supervisory layer. The contribution is not a single tool but an analytics pattern that connects algorithmic complexity, numerical precision, and practitioner workflow into one coherent monitoring surface.

Zitieren

APA

Liu, H., Bianchi, M., & Tanaka, Y. (2025). Precision-Aware Workload Analytics for AI Systems: A Unified Monitoring Framework Across PyTorch and Scikit-learn Pipelines. DATAMIND, 3(2), 5-19. https://doi.org/10.63646/datamind.2025.030202

Vancouver

Liu H, Bianchi M, Tanaka Y. Precision-Aware Workload Analytics for AI Systems: A Unified Monitoring Framework Across PyTorch and Scikit-learn Pipelines. DATAMIND. 2025;3(2):5-19. doi:10.63646/datamind.2025.030202

BibTeX
@article{Liu2025,
  author = {Liu, Haoran and Bianchi, Marco and Tanaka, Yuki},
  title = {Precision-Aware Workload Analytics for AI Systems: A Unified Monitoring Framework Across PyTorch and Scikit-learn Pipelines},
  journal = {DATAMIND},
  year = {2025},
  volume = {3},
  number = {2},
  pages = {5--19},
  doi = {10.63646/datamind.2025.030202}
}
Kostenlos starten →