NDLI: Automatic User Comment Detection in Flat Internet Fora

Content Provider	IEEE Xplore Digital Library
Author	Bank, M. Mattes, M.
Copyright Year	2009
Abstract	Millions of people are using the World Wide Web and are publishing content online. This user generated content contains many information relevant not only to marketing but to companies in general (customer-oriented products), governments (direct democracy) and many more. Analysis on such data becomes more and more important. This paper deals with a prerequisite: we propose an algorithm to automatically detect posting structures in flat internet fora to extract user comments. The algorithm is able to handle a wide range of different for a systems - even nested structures. The approach first detects the main content section by applying a modified version of the SST algorithm and then detects the posting structure by using several posting properties found in internet fora. It creates XPath expressions for faster data extraction in further steps.
Starting Page	373
Ending Page	377
File Size	687156
Page Count	5
File Format	PDF
ISBN	9780769537634
ISSN	15294188
DOI	10.1109/DEXA.2009.14
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-08-31
Publisher Place	Austria
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Internet Data mining User-generated content Mathematics Web sites Publishing Algorithm design and analysis Web pages Databases Expert systems extraction social media internet community forum web 2.0 Information Retrieval crawler
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Forum Data Extraction without Explicit Rules

ContentEx: A framework for automatic content extraction programs

Web user log mining for Web retrieval

BIIGLE Tools A Web 2.0 Approach for Visual Bioimage Database Mining

A template-based forum posts content extraction method

Change Detection in Web Pages

Design and Implementation of a Web Information Extraction System Based on R-G-B Algorithm

Automatic Template Detection for Structured Web Pages

AuToCrawler: an integrated system for automatic topical crawler

Automatic User Comment Detection in Flat Internet Fora

Similar Documents

Forum Data Extraction without Explicit Rules

ContentEx: A framework for automatic content extraction programs

Web user log mining for Web retrieval

BIIGLE Tools  A Web 2.0 Approach for Visual Bioimage Database Mining

A template-based forum posts content extraction method

Change Detection in Web Pages

Design and Implementation of a Web Information Extraction System Based on R-G-B Algorithm

Automatic Template Detection for Structured Web Pages

AuToCrawler: an integrated system for automatic topical crawler

Automatic User Comment Detection in Flat Internet Fora

BIIGLE Tools A Web 2.0 Approach for Visual Bioimage Database Mining