NDLI: CosDic: Towards a Comprehensive System for Knowledge Discovery in Large-Scale Data: Architecture, Implementation and Case Studies

Content Provider	IEEE Xplore Digital Library
Author	Wu, Bin Yang, Shengqi Zhao, Haizhou Gao, Yuan Suo, Lijun
Copyright Year	2009
Abstract	The continued exponential growth in both the volume and the complexity of information is giving birth to a new challenge to the specific requirements of analysts, researchers and intelligence providers. In this paper, to move the scientific activity forward to practice, we elaborate a prototype of our on-going constructed system, CosDic, for knowledge discovery from extremely large-scale datasets. The major infrastructure of CosDic is deployed on a distributed cluster environment using MapReduce platform. To undertake the mining tasks from gigabytes to petabytes, we carefully devised our system, from architecture to particular algorithms, from under layer construction to upper layer public service interface, from effectiveness to efficiency. Moreover, to illustrate its functionality, we employ CosDic to a real-world huge dataset and demonstrate an integrated analysis procedure from initial raw data preprocessing to finally knowledge discovering. We show that CosDic has a good performance in such cloud-scale data computing.
Starting Page	697
Ending Page	700
File Size	827310
Page Count	4
File Format	PDF
ISBN	9780769538013
DOI	10.1109/WI-IAT.2009.117
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-09-15
Publisher Place	Italy
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Pervasive computing Cloud computing distributed system knowledge discovery Distributed computing Intelligent agent MapReduce Prototypes Computer architecture Biology computing Parallel processing Large-scale systems Internet
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

CosDic: Towards a Comprehensive System for Knowledge Discovery in Large-Scale Data: Architecture, Implementation and Case Studies

Scalable Semantics The Silver Lining of Cloud Computing

GridBatch: Cloud Computing for Large-Scale Data-Intensive Batch Applications

An Analysis of Traces from a Production MapReduce Cluster

Improving resource utilization in a heterogeneous cloud environment

Cloud computing & multi-agent systems: A new promising approach for distributed data mining

A Distributed Multi-agent System implementation of the Human-Friendly MAS for Mining Stock Data

Interactive Rendering for Large-Scale Mesh Based on MapReduce

Implementation of a Large-Scalable Social Data Analysis System Based on MapReduce

CosDic: Towards a Comprehensive System for Knowledge Discovery in Large-Scale Data: Architecture, Implementation and Case Studies

Similar Documents

CosDic: Towards a Comprehensive System for Knowledge Discovery in Large-Scale Data: Architecture, Implementation and Case Studies

Scalable Semantics  The Silver Lining of Cloud Computing

GridBatch: Cloud Computing for Large-Scale Data-Intensive Batch Applications

An Analysis of Traces from a Production MapReduce Cluster

Improving resource utilization in a heterogeneous cloud environment

Cloud computing & multi-agent systems: A new promising approach for distributed data mining

A Distributed Multi-agent System implementation of the Human-Friendly MAS for Mining Stock Data

Interactive Rendering for Large-Scale Mesh Based on MapReduce

Implementation of a Large-Scalable Social Data Analysis System Based on MapReduce

CosDic: Towards a Comprehensive System for Knowledge Discovery in Large-Scale Data: Architecture, Implementation and Case Studies

Scalable Semantics The Silver Lining of Cloud Computing