Loading...
Please wait, while we are loading the content...
Similar Documents
Document Clustering using Word Clusters via the Information Bottleneck Method
| Content Provider | CiteSeerX |
|---|---|
| Author | Slonim, Noam Tish, Naftali |
| Abstract | We present a novel implementation of the recently introduced information bottleneck method for unsupervised document clustering. Given a joint empirical distribution of words and documents, s, , we first cluster the words, , so that the obtained word clusters, , maximally preserve the information on the documents. The resulting joint distribution, , contains most of the original information about the documents, , but it is much less sparse and noisy. Using the same procedure we then cluster the documents, , so that the information about the word-clusters is preserved. Thus, we first find word-clusters that capture most of the mutual information about the set of documents, and then find document clusters, that preserve the information about the word clusters. We tested this procedure over several document collections based on subsets taken from the standard "!$#% corpus. The results were assessed by calculating the correlation between the document clusters and the correct labels for these documents. Finding from our experiments show that this double clustering procedure, which uses the information bottleneck method, yields significantly superior performance compared to other common document distributional clustering algorithms. Moreover, the double clustering procedure improves all the distributional clustering methods examined here. |
| File Format | |
| Access Restriction | Open |
| Subject Keyword | Information Bottleneck Method Word Cluster Document Clustering Document Cluster Double Clustering Procedure Mutual Information Novel Implementation Standard Corpus Superior Performance Joint Empirical Distribution Obtained Word Cluster Unsupervised Document Clustering Joint Distribution Common Document Distributional Clustering Algorithm Several Document Collection Original Information Distributional Clustering Method Correct Label |
| Content Type | Text |
