NDLI: Reshaping automatic speech transcripts for robust high-level spoken document analysis

Please wait, while we are loading the content...

Document: a useful level for facing noisy data

The nature of noise in linguistic corpora

A platform for storing, visualizing, and interpreting collections of noisy documents

Extracting person names from diverse and noisy OCR text

The effects of learner errors on the development of a collocation detection tool

Improving accuracy of identifying clinical concepts in noisy unstructured clinical notes using existing internal redundancy

Clustering based approach to learning regular expressions over large alphabet for noisy unstructured text

Reshaping automatic speech transcripts for robust high-level spoken document analysis

Statement map: reducing web information credibility noise through opinion classification

Variant search and syntactic tree similarity based approach to retrieve matching questions for SMS queries

Discovering users' topics of interest on twitter: a first look

Tokenizing micro-blogging messages using a text classification approach

Reshaping automatic speech transcripts for robust high-level spoken document analysis

Content Provider	ACM Digital Library
Author	Raymond, Christian Gravier, Guillaume Fayolle, Julien Moreau, Fabienne
Abstract	High-level spoken document analysis is required in many applications seeking access to the semantic content of audio data, such as information retrieval, machine translation or automatic summarization. It is nevertheless a difficult task that is generally based on transcripts provided by an automatic speech recognition system. Unlike standard texts, transcripts belong to the category of highly noisy data because of word recognition errors that affect, in particular, very significant words such as named entities (e.g. person's names, locations, organizations). Transcripts also contain specificities of spoken language that make ineffective their processing by natural language processing tools designed for texts. To overcome these issues, this paper proposes a method to reshape automatic speech transcripts for robust high-level spoken document analysis. The method consists in conceiving a new word-level confidence measure that may efficiently ensure the reliability of transcribed words, focusing on words that are relevant for high-level spoken document analysis such as named entities. The approach consists in combining different features collected from various sources of knowledge thanks to a machine learning method based on conditional random fields. In addition to standard features (morphosyntactic, linguistic and phonetic), we introduce new semantic features based on the decisions of three robust named entity recognition systems to better estimate the reliability of named entities. Experiments, conducted on the French broadcast news corpus ESTER, demonstrate the added-value of the proposed word-level confidence measure for error detection and named entity recognition, with respect to the basic confidence measure provided by an automatic speech recognition system.
Starting Page	51
Ending Page	58
Page Count	8
File Format	PDF
ISBN	9781450303767
DOI	10.1145/1871840.1871849
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2010-10-26
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Named entities Word-level confidence measures Noisy transcription Spoken language processing Machine learning Feature combination Automatic speech recognition system
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in