NDLI: A hybrid machine-crowdsourcing system for matching web tables

Content Provider	IEEE Xplore Digital Library
Author	Ju Fan Meiyu Lu Beng Chin Ooi Wang-Chiew Tan Meihui Zhang
Copyright Year	2014
Description	Author affiliation: Univ. of California, CA, USA (Wang-Chiew Tan) \|\| Nat. Univ. of Singapore, Singapore, Singapore (Ju Fan; Meiyu Lu; Beng Chin Ooi; Meihui Zhang)
Abstract	The Web is teeming with rich structured information in the form of HTML tables, which provides us with the opportunity to build a knowledge repository by integrating these tables. An essential problem of web data integration is to discover semantic correspondences between web table columns, and schema matching is a popular means to determine the semantic correspondences. However, conventional schema matching techniques are not always effective for web table matching due to the incompleteness in web tables. In this paper, we propose a two-pronged approach for web table matching that effectively addresses the above difficulties. First, we propose a concept-based approach that maps each column of a web table to the best concept, in a well-developed knowledge base, that represents it. This approach overcomes the problem that sometimes values of two web table columns may be disjoint, even though the columns are related, due to incompleteness in the column values. Second, we develop a hybrid machine-crowdsourcing framework that leverages human intelligence to discern the concepts for “difficult” columns. Our overall framework assigns the most “beneficial” column-to-concept matching tasks to the crowd under a given budget and utilizes the crowdsourcing result to help our algorithm infer the best matches for the rest of the columns. We validate the effectiveness of our framework through an extensive experimental study over two real-world web table data sets. The results show that our two-pronged approach outperforms existing schema matching techniques at only a low cost for crowdsourcing.
Sponsorship	IEEE Comput. Soc.
Starting Page	976
Ending Page	987
File Size	533120
Page Count	12
File Format	PDF
ISBN	9781479925551
DOI	10.1109/ICDE.2014.6816716
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-03-31
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Films Catalogs Semantics Educational institutions Entropy Motion pictures Accuracy
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Hybrid Machine-Crowdsourcing System for Matching Web Tables

Constructing Chinese domain lexicon with improved entropy formula for sentiment analysis

An approach to automatical semantic analysis of Web query interfaces

Research on Column Concept Vector Based Web Table Matching

KUBERA: A security model for Web Applications

Multi-schema Matching Based on Web Structured Information Sources

Sentiment classification using summaries: A comparative investigation of lexical and statistical approaches

Machine learning for understanding the contextual semantics of tabular web sources

A Hybrid User Profile Model for Personalized Recommender System with Linked Open Data

A hybrid machine-crowdsourcing system for matching web tables

Similar Documents

A Hybrid Machine-Crowdsourcing System for Matching Web Tables

Constructing Chinese domain lexicon with improved entropy formula for sentiment analysis

An approach to automatical semantic analysis of Web query interfaces

Research on Column Concept Vector Based Web Table Matching

KUBERA: A security model for Web Applications

Multi-schema Matching Based on Web Structured Information Sources

Sentiment classification using summaries: A comparative investigation of lexical and statistical approaches

Machine learning for understanding the contextual semantics of tabular web sources

A Hybrid User Profile Model for Personalized Recommender System with Linked Open Data

A hybrid machine-crowdsourcing system for matching web tables