Loading...
Please wait, while we are loading the content...
Single-Pass Clustering Algorithm Based on Storm
| Content Provider | Scilit |
|---|---|
| Author | Fang, Li Longlong, Dai Zhiying, Jiang Shunzi, Li |
| Copyright Year | 2017 |
| Description | Journal: Journal of Physics: Conference Series The dramatically increasing volume of data makes the computational complexity of traditional clustering algorithm rise rapidly accordingly, which leads to the longer time. So as to improve the efficiency of the stream data clustering, a distributed real-time clustering algorithm (S-Single-Pass) based on the classic Single-Pass [1] algorithm and Storm [2] computation framework was designed in this paper. By employing this kind of method in the Topic Detection and Tracking (TDT) [3], the real-time performance of topic detection arises effectively. The proposed method splits the clustering process into two parts: one part is to form clusters for the multi-thread parallel clustering, the other part is to merge the generated clusters in the previous process and update the global clusters. Through the experimental results, the conclusion can be drawn that the proposed method have the nearly same clustering accuracy as the traditional Single-Pass algorithm and the clustering accuracy remains steady, computing rate increases linearly when increasing the number of cluster machines and nodes (processing threads). |
| Related Links | http://iopscience.iop.org/article/10.1088/1742-6596/806/1/012017/pdf |
| ISSN | 17426588 |
| e-ISSN | 17426596 |
| DOI | 10.1088/1742-6596/806/1/012017 |
| Journal | Journal of Physics: Conference Series |
| Issue Number | 1 |
| Volume Number | 806 |
| Language | English |
| Publisher | IOP Publishing |
| Publisher Date | 2017-02-21 |
| Access Restriction | Open |
| Subject Keyword | Journal: Journal of Physics: Conference Series Hardware and Architecture Topic Detection Clustering Accuracy Single Pass Pass Clustering Algorithm |
| Content Type | Text |
| Resource Type | Article |
| Subject | Physics and Astronomy |
