NDLI: Modeling and managing content changes in text databases

Content Provider	IEEE Xplore Digital Library
Author	Ipeirotis, P.G. Ntoulas, A. Cho, J. Gravano, L.
Copyright Year	2005
Description	Author affiliation: New York Univ., NY, USA (Ipeirotis, P.G.; Ntoulas, A.; Cho, J.; Gravano, L.)
Abstract	Large amounts of (often valuable) information are stored in Web-accessible text databases. "Metasearchers" provide unified interfaces to query multiple such databases at once. For efficiency, metasearchers rely on succinct statistical summaries of the database contents to select the best databases for each query. So far, database selection research has largely assumed that databases are static, so the associated statistical summaries do not need to change over time. However, databases are rarely static and the statistical summaries that describe their contents need to be updated periodically to reflect content changes. In this paper, we first report the results of a study showing how the content summaries of 152 real Web databases evolved over a period of 52 weeks. Then, we show how to use "survival analysis" techniques in general, and Cox's proportional hazards regression in particular, to model database changes over time and predict when we should update each content summary. Finally, we exploit our change model to devise update schedules that keep the summaries up to date by contacting databases only when needed, and then we evaluate the quality of our schedules experimentally over real Web databases.
Sponsorship	IEEE Comput. Soc. Database Soc. of Japan (DBSJ) Inf. Process. Soc. of Japan (IPSJ) Inst. of Electron., Inf. and Commun. Eng. (IEICE)
Starting Page	606
Ending Page	617
File Size	422073
Page Count	12
File Format	PDF
ISBN	0769522858
ISSN	10844627
DOI	10.1109/ICDE.2005.91
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2005-04-05
Publisher Place	Japan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Content management Databases Predictive models Statistics Hazards Search engines Aggregates Frequency Statistical analysis Pattern analysis
Content Type	Text
Resource Type	Article
Subject	Signal Processing Information Systems Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Towards Preference-aware Relational Databases

Nefertiti: a query by content software for three-dimensional models databases management

Modeling multidimensional databases

Information retrieval with distributed databases: analytic models of performance

A statistical modeling approach to content based video retrieval

Image segmentation search engine applied to a distributed archiving architecture for content retrieval system to educational products

Metadata integration framework for managing forest heterogeneous information resources

Obfuscating the Topical Intention in Enterprise Text Search

Holistically Twig Matching in Probabilistic XML

Modeling and managing content changes in text databases

Similar Documents

Towards Preference-aware Relational Databases

Nefertiti: a query by content software for three-dimensional models databases management

Modeling multidimensional databases

Information retrieval with distributed databases: analytic models of performance

A statistical modeling approach to content based video retrieval

Image segmentation search engine applied to a distributed archiving architecture for content retrieval system to educational products

Metadata integration framework for managing forest heterogeneous information resources

Obfuscating the Topical Intention in Enterprise Text Search

Holistically Twig Matching in Probabilistic XML

Modeling and managing content changes in text databases