NDLI: On scaling latent semantic indexing for large peer-to-peer systems

Please wait, while we are loading the content...

Evaluating high accuracy retrieval techniques

Retrieval evaluation with incomplete information

A formal study of information retrieval heuristics

The overlap problem in content-oriented XML retrieval evaluation

Locality preserving indexing for document representation

GaP: a factor model for discrete data

Translating unknown queries with web corpora for cross-language information retrieval

Dependence language model for information retrieval

Document clustering by concept factorization

Feature selection using linear classifier weights: interaction with classification models

Information retrieval using word senses: root sense tagging approach

Focused named entity recognition using machine learning

Assigning identifiers to documents to enhance the clustering property of fulltext indexes

A collaborative filtering algorithm and evaluation metric that accurately model the user experience

Automatic image annotation by using concept-sensitive salient objects for image content representation

Learning effective ranking functions for newsgroup search

Evaluation of an extraction-based approach to answering definitional questions

Block-level link analysis

A hybrid statistical/linguistic model for generating news story gists

Improving document representation by accumulating relevance feedback (abstract only): the relevance feedback accumulation algorithm

Challenges in using lifetime personal information stores

Scaling IR-system evaluation using term relevance sets

Forming test collections with no system pooling

Probabilistic model for contextual retrieval

Length normalization in XML retrieval

Polynomial filtering in latent semantic indexing for information retrieval

Belief revision for adaptive information retrieval

Resource selection for domain-specific cross-lingual IR

Parsimonious language models for information retrieval

Learning to cluster web search results

Web-page classification through summarization

An effective approach to document retrieval via utilizing WordNet and recognizing phrases

Learning phonetic similarity for matching named entity translations and mining new translations

Filtering algorithms for information retrieval models with named attributes and proximity operators

An automatic weighting scheme for collaborative filtering

A search engine for historical manuscript images

Language-specific models in multilingual topic tracking

Query based event extraction along a timeline

Usefulness of hyperlink structure for query-biased topic distillation

Image based gisting in CLIR

Supporting federated information sharing communities (abstract only)

Chemoinformatics: an application domain for information retrieval techniques

Using temporal profiles of queries for precision prediction

Building an information retrieval test collection for spontaneous conversational speech

Discriminative models for information retrieval

Configurable indexing and ranking for XML information retrieval

On scaling latent semantic indexing for large peer-to-peer systems

Tuning before feedback: combining ranking discovery and blind feedback for robust retrieval

Using the web for automated translation extraction in cross-language information retrieval

Cluster-based retrieval using language models

Document clustering via adaptive subspace iteration

Parameterized generation of labeled datasets for text categorization based on a hierarchical directory

Web-a-where: geotagging web content

Text classification and named entities for new event detection

Hourly analysis of a very large topically categorized web query log

Using bayesian priors to combine classifiers for adaptive filtering

Display time as implicit feedback: understanding task effects

Web taxonomy integration through co-bootstrapping

Sentence completion

Block-based web search

Classifying racist texts using a support vector machine

Toponym resolution in text (abstract only): "which sheffield is it?"

Corpus structure, language models, and ad hoc information retrieval

Restrictive clustering and metaclustering for self-organizing document collections

A nonparametric hierarchical bayesian framework for information filtering

Human versus machine in the topic distillation task

Discovery of aggregate usage profiles based on clustering information needs

Sharing knowledge online (abstract only): a dream or reality?

Merging retrieval results in hierarchical peer-to-peer networks

Reliability and verification of natural language text on the world wide web (abstract only)

The effect of back-formulating questions in question answering evaluation

Discovering and representing the contextual and narrative structure of e-books to support reading and comprehension (abstract only)

Effect of varying number of documents in blind feedback: analysis of the 2003 NRRC RIA workshop "bf_numdocs" experiment suite

Understanding combination of evidence using generative probabilistic models for information retrieval (abstract only)

Eye-tracking analysis of user behavior in WWW search

An artificial intelligence approach to information retrieval (abstract only)

Subwebs for specialized search

Supporting multiple information-seeking strategies in a single system framework (abstract only)

Comparison of using passages and documents for blind relevance feedback in information retrieval

Measuring pseudo relevance feedback & CLIR

A two-stage mixture model for pseudo feedback

Natural language processing for browse help

Triangulation without translation

A session-based search engine

Evaluation of filtering current news search results

The document as an ergodic markov chain

Expertise community detection

Learning patterns to answer open domain questions on the web

Email is a stage: discovering people roles from email archives

Searching databases for sematically-related schemas

Topic prediction based on comparative retrieval rankings

Context-based question-answering evaluation

Design of an e-book user interface and visualizations to support reading for comprehension

Toward better weighting of anchors

Aggregated feature retrieval for MPEG-7 via clustering

Answer models for question answering passage retrieval

Collaborative filing in a document repository

A study of topic similarity measures

Effectiveness of web page classification on finding list answers

Detection and translation of OOV terms prior to query time

Evaluation of the real and perceived value of automatic and interactive query expansion

The NRRC reliable information access (RIA) workshop

On evaluating web search with very few relevant documents

A music recommender based on audio features

Information extraction using two-phase pattern discovery

A search engine for imaged documents in PDF files

Context sensitive vocabulary and its application in protein secondary structure prediction

Formal multiple-bernoulli models for language modeling

User biased document language modelling

Information retrieval for language tutoring: an overview of the REAP project

A unified model of literal mining and link analysis for ranking web resources

Automatic recognition of reading levels from user queries

A joint framework for collaborative and content filtering

Refining term weights of documents using term dependencies

Multiple sources of evidence for XML retrieval

Verifying a Chinese collection for text categorization

Query-related data extraction of hidden web documents

The patent retrieval task in the fourth NTCIR workshop

Measuring ineffectiveness

Information retrieval using hierarchical dirichlet processes

Broken plural detection for arabic information retrieval

A study of methods for normalizing user ratings in collaborative filtering

A review of relevance feedback experiments at the 2003 reliable information access (RIA) workshop.

Supporting federated information sharing communities

The effect of document retrieval quality on factoid question answering performance

Exploiting hyperlink recommendation evidence in navigational web search

Context-based methods for text categorisation

eMailSift: mining-based approaches to email classification

Constructing a text corpus for inexact duplicate detection

Why current IR engines fail

Automatic sense disambiguation for acronyms

Filtering for personal web information agents

Evaluating content-based filters for image and video retrieval

Semantic video classification by integrating unlabeled samples for classifier training

Implicit queries (IQ) for contextualized search

An implicit system for predicting interests

Geotemporal querying of multilingual documents

ACES: a contextual engine for search

Armadillo: harvesting information for the semantic web

UKSearch: search with automatically acquired domain knowledge

Geographic information retrieval (GIR): searching where and what

On scaling latent semantic indexing for large peer-to-peer systems

Content Provider	ACM Digital Library
Author	Dwarkadas, Sandhya Tang, Chunqiang Xu, Zhichen
Abstract	The exponential growth of data demands scalable infrastructures capable of indexing and searching rich content such as text, music, and images. A promising direction is to combine information re-trieval with peer-to-peer technology for scalability, fault-tolerance, and low administration cost. One pioneering work along this di-rection is pSearch [32, 33]. pSearch places documents onto a peer-to- peer overlay network according to semantic vectors produced using Latent Semantic Indexing (LSI). The search cost for a query is reduced since documents related to the query are likely to be co-located on a small number of nodes. Unfortunately, because of its reliance on LSI, pSearch also inherits the limitations of LSI. (1) When the corpus is large and heterogeneous, LSI's retrieval quality is inferior to methods such as Okapi. (2) The Singular Value Decomposition (SVD) used in LSI is unscalable in terms of both memory consumption and computation time.This paper addresses the above limitations of LSI and makes the following contributions. (1) To reduce the cost of SVD, we reduce the size of its input matrix through document clustering and term selection. Our method retains the retrieval quality of LSI but is several orders of magnitude more efficient. (2) Through extensive experimentation, we found that proper normalization of semantic vectors for terms and documents improves recall by 76%. (3) To further improve retrieval quality, we use low-dimensional subvectors of semantic vectors to cluster documents in the overlay and then use Okapi to guide the search and document selection.
Starting Page	112
Ending Page	121
Page Count	10
File Format	PDF
ISBN	1581138814
DOI	10.1145/1008992.1009014
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2004-07-25
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Dimensionality reduction Peer-to-peer ir Latent semantic indexing
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in