Optimizing large-scale graph database ingestion through edge value ranking: a proposed framework
Frontiers in Big Data · 11.05.2026 · 9
DOI: 10.3389/fdata.2026.1768571 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Big Data, online erschienen am 11.05.2026. Verfasst von Phanindra Reddy Madduru und 1 weiteren Autor:innen. Beteiligte Einrichtung: Amazon.com, Seattle, WA, United States. Die Arbeit nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This paper proposes a preprocessing framework for optimizing large-scale graph database ingestion through intelligent edge filtering based on value ranking. We combine adapted PageRank algorithms with business-specific metrics and edge type importance to evaluate and rank edges, enabling selective retention of high-value relationships. The framework introduces three PageRank variants (maximum weight normalization, weighted average, and log-based normalization) with type-specific business value normalization to handle heterogeneous graphs. Current graph database ingestion approaches struggle with scale: loading 6.2TB of data (38 billion objects) requires over 3 weeks, forcing organizations to limit historical data retention. Our approach addresses this through preprocessing-stage filtering before database ingestion. While requiring experimental validation, preliminary analysis suggests potential for 40%–80% data volume reduction depending on graph characteristics, with corresponding improvements in loading efficiency and storage costs. The paper details the theoretical framework, computational complexity analysis, formal property preservation guarantees, and comprehensive validation methodology. This work represents a novel direction in graph database optimization: value-based preprocessing rather than runtime query optimization.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Amazon.com, Seattle, WA, United States.
Zitieren
APA
Madduru, P. R., & Thomas, B. (2026). Optimizing large-scale graph database ingestion through edge value ranking: a proposed framework. Frontiers in Big Data, 9. https://doi.org/10.3389/fdata.2026.1768571
Vancouver
Madduru PR, Thomas B. Optimizing large-scale graph database ingestion through edge value ranking: a proposed framework. Frontiers in Big Data. 2026;9. doi:10.3389/fdata.2026.1768571
BibTeX
@article{Madduru2026,
author = {Madduru, Phanindra Reddy and Thomas, Bijo},
title = {Optimizing large-scale graph database ingestion through edge value ranking: a proposed framework},
journal = {Frontiers in Big Data},
year = {2026},
volume = {9},
doi = {10.3389/fdata.2026.1768571}
}
EUVIMED