NDLI: Web page DOM node characterization and its application to page segmentation

Content Provider	IEEE Xplore Digital Library
Author	Vineel, G.
Copyright Year	2009
Description	Author affiliation: Computing and Decision Sciences Lab, GE Research, INDIA (Vineel, G.)
Abstract	Web pages are generally organized in terms of visually distinct segments, such as Navigation bars, Advertisement banners, Headers, Portlets and Widgets. Despite the apparent structured layout, web pages are considered a source of unstructured data, from information extraction point of view. Hence, as a step towards interpreting the organization of web data, web page segmentation attempts to identify cohesive regions of a page. In this paper, we present a novel DOM tree mining approach for page segmentation. We first characterize the nodes of DOM tree structure, based on their Content Size and Entropy. While Content Size of a node indicates the amount of textual content contributed by its subtree, Entropy measures the strength of local “patterns” exhibited therein. In other words, a node manifesting highly repetitive patterns begets a high Entropy as per our formulation. Based on the characterization of DOM nodes, we then develop an unsupervised algorithm to automatically identify segments of a given web page.
Starting Page	1
Ending Page	6
File Size	376346
Page Count	6
File Format	PDF
ISBN	9781424447923
DOI	10.1109/IMSAA.2009.5439444
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-12-09
Publisher Place	India
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Tree data structures Navigation Size measurement HTML Entropy Data mining Document Object Model Tree graphs Web Page Segmentation Web pages Usability Web Information Extraction Bars
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A novel approach for content extraction from web pages

Web information extraction based on IEBIDTech

An approach for text extraction from web news page

Web Object Block Mining Based on Tag Similarity

Efficient Web Page Main Text Extraction towards Online News Analysis

Web document information extraction using class attribute approach

Web structure mining for usability analysis

Web Information Extraction Algorithm Based on Ontology and DOM Tree

VEDD- a visual wrapper for extraction of data using DOM tree

Web page DOM node characterization and its application to page segmentation

Similar Documents

A novel approach for content extraction from web pages

Web information extraction based on IEBIDTech

An approach for text extraction from web news page

Web Object Block Mining Based on Tag Similarity

Efficient Web Page Main Text Extraction towards Online News Analysis

Web document information extraction using class attribute approach

Web structure mining for usability analysis

Web Information Extraction Algorithm Based on Ontology and DOM Tree

VEDD- a visual wrapper for extraction of data using DOM tree

Web page DOM node characterization and its application to page segmentation