EUVIMEDOpdag EUVIMED
Crossref

Web Crawling

Christopher Olston, Marc Najork

Foundations and Trends® in Information Retrieval · 2010-02-12 · 4 (3) · 175-246

DOI: 10.1561/1500000017 ↗

At a glance

Journal article in Foundations and Trends® in Information Retrieval, published online on 2010-02-12. Written by Christopher Olston and 1 co-authors. Cited 257 times so far (Crossref); 121 references.

AbstractBibliografiske oplysningerCite

Abstract (original language)

This is a survey of the science and practice of web crawling. While at first glance web crawling may appear to be merely an application of breadth-first-search, the truth is that there are many challenges ranging from systems concerns such as managing very large data structures to theoretical questions such as how often to revisit evolving content sources. This survey outlines the fundamental challenges and describes the state-of-the-art models and solutions. It also highlights avenues for future work.

Cite

APA

Olston, C., & Najork, M. (2010). Web Crawling. Foundations and Trends® in Information Retrieval, 4(3), 175-246. https://doi.org/10.1561/1500000017

Vancouver

Olston C, Najork M. Web Crawling. Foundations and Trends® in Information Retrieval. 2010;4(3):175-246. doi:10.1561/1500000017

BibTeX
@article{Olston2010,
  author = {Olston, Christopher and Najork, Marc},
  title = {Web Crawling},
  journal = {Foundations and Trends® in Information Retrieval},
  year = {2010},
  volume = {4},
  number = {3},
  pages = {175--246},
  doi = {10.1561/1500000017}
}
Start for free →