NDLI: Regularized Latent Semantic Indexing: A New Approach to Large-Scale Topic Modeling

Content Provider	ACM Digital Library
Author	Li, Hang Xu, Jun Craswell, Nick Wang, Quan
Copyright Year	2013
Abstract	Topic modeling provides a powerful way to analyze the content of a collection of documents. It has become a popular tool in many research areas, such as text mining, information retrieval, natural language processing, and other related fields. In real-world applications, however, the usefulness of topic modeling is limited due to scalability issues. Scaling to larger document collections via parallelization is an active area of research, but most solutions require drastic steps, such as vastly reducing input vocabulary. In this article we introduce Regularized Latent Semantic Indexing (RLSI)---including a batch version and an online version, referred to as batch RLSI and online RLSI, respectively---to scale up topic modeling. Batch RLSI and online RLSI are as effective as existing topic modeling techniques and can scale to larger datasets without reducing input vocabulary. Moreover, online RLSI can be applied to stream data and can capture the dynamic evolution of topics. Both versions of RLSI formalize topic modeling as a problem of minimizing a quadratic loss function regularized by ℓ1 and/or ℓ2 norm. This formulation allows the learning process to be decomposed into multiple suboptimization problems which can be optimized in parallel, for example, via MapReduce. We particularly propose adopting ℓ1 norm on topics and ℓ2 norm on document representations to create a model with compact and readable topics and which is useful for retrieval. In learning, batch RLSI processes all the documents in the collection as a whole, while online RLSI processes the documents in the collection one by one. We also prove the convergence of the learning of online RLSI. Relevance ranking experiments on three TREC datasets show that batch RLSI and online RLSI perform better than LSI, PLSI, LDA, and NMF, and the improvements are sometimes statistically significant. Experiments on a Web dataset containing about 1.6 million documents and 7 million terms, demonstrate a similar boost in performance.
Starting Page	1
Ending Page	44
Page Count	44
File Format	PDF
ISSN	10468188
e-ISSN	15582868
DOI	10.1145/2414782.2414787
Volume Number	31
Issue Number	1
Journal	ACM Transactions on Information Systems (TOIS)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-01-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Topic modeling Distributed learning Online learning Regularization Sparse methods
Content Type	Text
Resource Type	Article
Subject	Computer Science Applications Information Systems Business, Management and Accounting

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Regularized latent semantic indexing

ARegularized Latent Semantic Indexing: A New Approach to Large Scale Topic Modeling

A semidiscrete matrix decomposition for latent semantic indexing information retrieval

An Improved Regularized Latent Semantic Indexing with L1/2 Regularization and Non-negative Constraints

Sparse online topic models.

Sparse Online Topic Models

Sparse online topic models

An analysis of latent semantic term self-correlation

Latent semantic models for collaborative filtering

Regularized Latent Semantic Indexing: A New Approach to Large-Scale Topic Modeling

Similar Documents

Regularized latent semantic indexing

ARegularized Latent Semantic Indexing: A New Approach to Large Scale Topic Modeling

A semidiscrete matrix decomposition for latent semantic indexing information retrieval

An Improved Regularized Latent Semantic Indexing with L1/2 Regularization and Non-negative Constraints

Sparse online topic models.

Sparse Online Topic Models

Sparse online topic models

An analysis of latent semantic term self-correlation

Latent semantic models for collaborative filtering

Regularized Latent Semantic Indexing: A New Approach to Large-Scale Topic Modeling