NDLI: Qualitative effects of knowledge rules and user feedback in probabilistic data integration

Content Provider	Springer Nature Link
Author	Keulen, Maurice Keijzer, Ander
Copyright Year	2009
Abstract	In data integration efforts, portal development in particular, much development time is devoted to entity resolution. Often advanced similarity measurement techniques are used to remove semantic duplicates or solve other semantic conflicts. It proves impossible, however, to automatically get rid of all semantic problems. An often-used rule of thumb states that about 90% of the development effort is devoted to semi-automatically resolving the remaining 10% hard cases. In an attempt to significantly decrease human effort at data integration time, we have proposed an approach that strives for a ‘good enough’ initial integration which stores any remaining semantic uncertainty and conflicts in a probabilistic database. The remaining cases are to be resolved with user feedback during query time. The main contribution of this paper is an experimental investigation of the effects and sensitivity of rule definition, threshold tuning, and user feedback on the integration quality. We claim that our approach indeed reduces development effort—and not merely shifts the effort—by showing that setting rough safe thresholds and defining only a few rules suffices to produce a ‘good enough’ initial integration that can be meaningfully used, and that user feedback is effective in gradually improving the integration quality.
Starting Page	1191
Ending Page	1217
Page Count	27
File Format	PDF
ISSN	10668888
Journal	The VLDB Journal
Volume Number	18
Issue Number	5
e-ISSN	0949877X
Language	English
Publisher	Springer-Verlag
Publisher Date	2009-07-21
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Data integration Entity resolution Uncertain databases Data quality User feedback Database Management
Content Type	Text
Resource Type	Article
Subject	Information Systems Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Entity resolution for distributed probabilistic data

Incremental entity resolution on rules and data

Generic entity resolution with negative rules

Special issue on uncertain and probabilistic databases

Large-scale linked data integration using probabilistic reasoning and crowdsourcing

Probabilistic inverse ranking queries in uncertain databases

Creating probabilistic databases from duplicated data

Swoosh: a generic approach to entity resolution

Probabilistic nearest neighbor query processing on distributed uncertain data

Qualitative effects of knowledge rules and user feedback in probabilistic data integration

Similar Documents

Entity resolution for distributed probabilistic data

Incremental entity resolution on rules and data

Generic entity resolution with negative rules

Special issue on uncertain and probabilistic databases

Large-scale linked data integration using probabilistic reasoning and crowdsourcing

Probabilistic inverse ranking queries in uncertain databases

Creating probabilistic databases from duplicated data

Swoosh: a generic approach to entity resolution

Probabilistic nearest neighbor query processing on distributed uncertain data

Qualitative effects of knowledge rules and user feedback in probabilistic data integration