NDLI: Spoken Content Retrieval—Beyond Cascading Speech Recognition with Text Retrieval

Please wait, while we are loading the content...

Spoken Content Retrieval—Beyond Cascading Speech Recognition with Text Retrieval

Content Provider	IEEE Xplore Digital Library
Author	Lin-shan Lee Glass, J. Hung-yi Lee Chun-an Chan
Copyright Year	2014
Abstract	Spoken content retrieval refers to directly indexing and retrieving spoken content based on the audio rather than text descriptions. This potentially eliminates the requirement of producing text descriptions for multimedia content for indexing and retrieval purposes, and is able to precisely locate the exact time the desired information appears in the multimedia. Spoken content retrieval has been very successfully achieved with the basic approach of cascading automatic speech recognition (ASR) with text information retrieval: after the spoken content is transcribed into text or lattice format, a text retrieval engine searches over the ASR output to find desired information. This framework works well when the ASR accuracy is relatively high, but becomes less adequate when more challenging real-world scenarios are considered, since retrieval performance depends heavily on ASR accuracy. This challenge leads to the emergence of another approach to spoken content retrieval: to go beyond the basic framework of cascading ASR with text retrieval in order to have retrieval performances that are less dependent on ASR accuracy. This overview article is intended to provide a thorough overview of the concepts, principles, approaches, and achievements of major technical contributions along this line of investigation. This includes five major directions: 1) Modified ASR for Retrieval Purposes: cascading ASR with text retrieval, but the ASR is modified or optimized for spoken content retrieval purposes; 2) Exploiting the Information not present in ASR outputs: to try to utilize the information in speech signals inevitably lost when transcribed into phonemes and words; 3) Directly Matching at the Acoustic Level without ASR: for spoken queries, the signals can be directly matched at the acoustic level, rather than at the phoneme or word levels, bypassing all ASR issues; 4) Semantic Retrieval of Spoken Content: trying to retrieve spoken content that is semantically related to the query, but not necessarily including the query terms themselves; 5) Interactive Retrieval and Efficient Presentation of the Retrieved Objects: with efficient presentation of the retrieved objects, an interactive retrieval process incorporating user actions may produce better retrieval results and user experiences.
Starting Page	1389
Ending Page	1420
Page Count	32
File Size	2527375
File Format	PDF
ISSN	23299290
Volume Number	23
Issue Number	9
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech Speech recognition Multimedia communication Speech processing Accuracy Acoustics Indexing key term extraction Spoken content retrieval spoken term detection query by example semantic retrieval joint optimization pseudo-relevance feedback graph-based random walk unsupervised acoustic pattern discovery query expansion interactive retrieval summarization
Content Type	Text
Resource Type	Article
Subject	Acoustics and Ultrasonics Signal Processing Instrumentation Speech and Hearing Electrical and Electronic Engineering Computational Mathematics Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Spoken content retrieval: beyond cascading speech recognition with text retrieval

Improved Semantic Retrieval of Spoken Content by Document/Query Expansion with Random Walk Over Acoustic Similarity Graphs

Spoken Document Retrieval With Unsupervised Query Modeling Techniques

Interactive Indexing and Retrieval of Multimedia Content (2002)

Improved Semantic Retrieval of Spoken Content by Document/Query Expansion with Random Walk Over Acoustic Similarity Graphs

Integrating Recognition and Retrieval With Relevance Feedback for Spoken Term Detection

datak Spoken query processing for interactive information retrieval (2001)

Spoken query processing for interactive information retrieval

Towards unsupervised semantic retrieval of spoken content with query expansion based on automatically discovered acoustic patterns

Spoken Content Retrieval—Beyond Cascading Speech Recognition with Text Retrieval

Similar Documents

Spoken content retrieval: beyond cascading speech recognition with text retrieval

Improved Semantic Retrieval of Spoken Content by Document/Query Expansion with Random Walk Over Acoustic Similarity Graphs

Spoken Document Retrieval With Unsupervised Query Modeling Techniques

Interactive Indexing and Retrieval of Multimedia Content (2002)

Improved Semantic Retrieval of Spoken Content by Document/Query Expansion with Random Walk Over Acoustic Similarity Graphs

Integrating Recognition and Retrieval With Relevance Feedback for Spoken Term Detection

datak Spoken query processing for interactive information retrieval (2001)

Spoken query processing for interactive information retrieval

Towards unsupervised semantic retrieval of spoken content with query expansion based on automatically discovered acoustic patterns

Spoken Content Retrieval—Beyond Cascading Speech Recognition with Text Retrieval