Loading...
Please wait, while we are loading the content...
Similar Documents
Stanford WebBase Components and Applications
| Content Provider | CiteSeerX |
|---|---|
| Author | Haveliwala, Taher Garcia-Molina, Hector Lam, Wang Raghavan, Sriram Wesley, Gary Cho, Junghoo Paepcke, Andreas |
| Abstract | We describe the design and performance of WebBase, a tool for Web research. The system includes a highly customizable crawler, a repository for collected Web pages, an indexer for both text and link-related page features, and a high-speed content distribution facility. The distribution module enables researchers world-wide to retrieve pages from WebBase, and stream them across the Internet at high speed. the Web before beginning their research. The advantage for the researchers is that they need not all crawl WebBase has been used by scores of research and teaching organizations world-wide, mostly for investigations into Web topology and linguistic content analysis. After describing the system’s architecture, we explain our engineering decisions for each of the WebBase components, and present respective performance measurements. |
| File Format | |
| Access Restriction | Open |
| Subject Keyword | Distribution Module Web Page Link-related Page Feature Stanford Webbase Component Webbase Component Crawl Webbase Engineering Decision High Speed Web Topology Web Research System Architecture High-speed Content Distribution Facility Customizable Crawler Present Respective Performance Measurement Linguistic Content Analysis |
| Content Type | Text |
