Intelligent Data Catalogs Using Metadata Automation: Architectures, Standards, and Scalable Frameworks for Modern Data Ecosystems
International Journal of Scientific Research in Science and Technology · 26.05.2024 · 11 (3) · 1037-1052
DOI: 10.32628/ijsrst54310302 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Scientific Research in Science and Technology, online erschienen am 26.05.2024. Verfasst von Srinivasa Rao Seetala. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Modern enterprises generate vast volumes of structured and unstructured data across distributed environments, including cloud platforms, on-premises systems, IoT streams, and data lakes, creating significant challenges in organizing, accessing, and governing these assets effectively. Traditional data management approaches, which rely heavily on manual documentation, siloed repositories, and static metadata definitions, struggle to ensure discoverability, governance, data quality, and usability at scale, often leading to data redundancy, inconsistency, and limited trust in analytics outcomes. In response to these challenges, intelligent data catalogs powered by automated metadata ingestion, enrichment, and classification have emerged as a critical solution for enabling efficient data discovery, end-to-end lineage tracking, regulatory compliance, and collaborative data usage across organizations. These systems leverage advanced techniques such as machine learning, semantic modeling, and knowledge graphs to transform metadata into a dynamic, context-aware asset that supports real-time insights and decision-making. This paper explores the evolution of metadata systems from early foundational frameworks in the 2000s, which emphasized standardization and interoperability, to modern intelligent data catalog platforms developed prior to 2024 that integrate automation, scalability, and semantic intelligence. It highlights key architectural models, metadata lifecycle automation techniques, and distributed system considerations, while synthesizing insights from established metadata standards, academic literature on data catalogs, and large-scale metadata management systems to propose a comprehensive, scalable framework for building intelligent, metadata-driven ecosystems that enhance data accessibility, governance, and enterprise innovation.
Zitieren
APA
Seetala, S. R. (2024). Intelligent Data Catalogs Using Metadata Automation: Architectures, Standards, and Scalable Frameworks for Modern Data Ecosystems. International Journal of Scientific Research in Science and Technology, 11(3), 1037-1052. https://doi.org/10.32628/ijsrst54310302
Vancouver
Seetala SR. Intelligent Data Catalogs Using Metadata Automation: Architectures, Standards, and Scalable Frameworks for Modern Data Ecosystems. International Journal of Scientific Research in Science and Technology. 2024;11(3):1037-1052. doi:10.32628/ijsrst54310302
BibTeX
@article{Seetala2024,
author = {Seetala, Srinivasa Rao},
title = {Intelligent Data Catalogs Using Metadata Automation: Architectures, Standards, and Scalable Frameworks for Modern Data Ecosystems},
journal = {International Journal of Scientific Research in Science and Technology},
year = {2024},
volume = {11},
number = {3},
pages = {1037--1052},
doi = {10.32628/ijsrst54310302}
}
EUVIMED