CRAWLDoc: A System for Contextual Ranking and Bibliographic Metadata Extraction from Web Resources
Information Retrieval Research · 2026
DOI: 10.54195/irrj.23861 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information Retrieval Research, 2026. Verfasst von Fabian Karl und 1 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Publication databases rely on accurate metadata extraction from diverse web sources, yet variations in web layouts and data formats present challenges for metadata providers. This paper introduces CRAWLDoc, a novel system for contextual ranking of linked documents and metadata extraction from web resources. Using a publication’s DOI, CRAWLDoc retrieves the landing page and associated linked documents, including PDFs, ORCID profiles, and supplementary materials. It embeds these documents, along with anchor texts and URLs, into a unified representation. Our layout-independent embedding and ranking system ensures robustness across various web layouts and formats. Experimental results demonstrate CRAWLDoc’s superior performance in extracting bibliographic metadata compared to relying solely on landing pages. A leave-one-out experiment across six publishers shows CRAWLDoc’s resilience to layout changes and consistent extraction accuracy. Our source code and dataset can be accessed at https://github.com/FKarl/crawldoc-metadata-extraction
Zitieren
APA
Karl, F., & Scherp, A. (2026). CRAWLDoc: A System for Contextual Ranking and Bibliographic Metadata Extraction from Web Resources. Information Retrieval Research. https://doi.org/10.54195/irrj.23861
Vancouver
Karl F, Scherp A. CRAWLDoc: A System for Contextual Ranking and Bibliographic Metadata Extraction from Web Resources. Information Retrieval Research. 2026. doi:10.54195/irrj.23861
BibTeX
@article{Karl2026,
author = {Karl, Fabian and Scherp, Ansgar},
title = {CRAWLDoc: A System for Contextual Ranking and Bibliographic Metadata Extraction from Web Resources},
journal = {Information Retrieval Research},
year = {2026},
doi = {10.54195/irrj.23861}
}
EUVIMED