NDLI: Using visual pages analysis for optimizing web archiving

Please wait, while we are loading the content...

Flexible Dataspace Management Through Model Management

Research challenges for cloud intelligence: invited talk

Analysis of declarative updates: invited talk

Definitions matter: reconciling differential and adversarial privacy: invited talk

Enabling knowledge-based complex event processing

A multi-agent approach for generating ontologies and composing services into executable workflows

Leveraging web streams for contractual situational awareness in operational BI

Regular tree patterns: a uniform formalism for update queries and functional dependencies in XML

A practice-oriented framework for measuring privacy and utility in data sanitization systems

Enabling ontology evolution in data integration

Semantic search using modular ontology learning and case-based reasoning

Using web-based personalization on spatial data warehouses

Reasoning about client-side web programs: invited talk

A method for evaluating marketer re-identification risk

Integration and evolution of XML data via common data model

SPARQL query rewriting for implementing data integration over linked data

Building data warehouses with semantic data

The view update problem for XML

Expressing privacy metrics as one-symbol information

Biochemical network matching and composition

XML secure views using semantic access control

Model driven development of secure XML data warehouses: a case study

EXup: an engine for the evolution of XML schemas and associated documents

Protecting data privacy in outsourcing scenarios: invited talk

Declarative scheduling in highly scalable systems

A decision support system to improve e-learning environments

Updating probabilistic XML

Collaborative data privacy for the web

A small-world DHT built on generalized network coordinates

ODBIS: towards a platform for on-demand business intelligence services

Desirable properties for XML update mechanisms

Analysis of social networking privacy policies

Using visual pages analysis for optimizing web archiving

An architecture for ad-hoc and collaborative business intelligence

Updating relational data via SPARQL/update

Quantile-based bootstrap methods to generate continuous synthetic data

Text-to-query: dynamically building structured analytics to illustrate textual content

Updates, consistency, and the art of running XQuery in the cloud: invited talk

Key escrow schemes with sliding window for privacy-aware anomaly detection system

The benefits of the interaction between data warehouses and question answering

Hiding co-occurring sensitive patterns in progressive databases

Ontology-based news recommendation

Toward a software development methodology for anonymity applications

Using visual pages analysis for optimizing web archiving

Content Provider	ACM Digital Library
Author	Saad, Myriam Ben Gançarski, Stéphane
Abstract	Due to the growing importance of the World Wide Web, archiving it has become crucial for preserving useful source of information. To maintain a web archive up-to-date, crawlers harvest the web by iteratively downloading new versions of documents. However, it is frequent that crawlers retrieve pages with unimportant changes such as advertisements which are continually updated. Hence, web archive systems waste time and space for indexing and storing useless page versions. Also, querying the archive can take more time due to the large set of useless page versions stored. Thus, an effective method is required to know accurately when and how often important changes between versions occur in order to efficiently archive web pages. Our work focuses on addressing this requirement through a new web archiving approach that detects important changes between page versions. This approach consists in archiving the visual layout structure of a web page represented by semantic blocks. This work seeks to describe the proposed approach and to examine various related issues such as using the importance of changes between versions to optimize web crawl scheduling. The major interesting research questions that we would like to address in the future are introduced.
Starting Page	1
Ending Page	7
Page Count	7
File Format	PDF
ISBN	9781605589909
DOI	10.1145/1754239.1754287
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2010-03-22
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Web crawling Change detection Visual page analysis Web archiving
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in