NDLI: Automatic Synchronization of live speech and its Transcripts based on a frame-synchronous likelihood ratio test

Content Provider	IEEE Xplore Digital Library
Author	Jie Gao Qingwei Zhao Yonghong Yan
Copyright Year	2010
Description	Author affiliation: ThinkIT Speech Lab, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China (Jie Gao; Qingwei Zhao; Yonghong Yan)
Abstract	In this paper, we present our initial efforts in the task of Automatically Synchronizing live spoken Utterances with their Transcripts (textual contents) (ASUT) when the texts are known. We treat it as a online speech-text alignment problem. And it is further simplified into the problem of on-the-fly detecting of the end time of a spoken utterance given its textual content. A general framework called frame-synchronous likelihood ratio test (FS-LRT) procedure is proposed for this end time detection task and explored with the hidden Markov models (HMMs). The property of FS-LRT is studied empirically. Extensive experiments indicate that our proposed approach shows satisfying performance. In addition, FS-LRT has been successfully applied in a subtitling system for live broadcast news.
Starting Page	1622
Ending Page	1625
File Size	229353
Page Count	4
File Format	PDF
ISBN	9781424442959
ISSN	15206149
DOI	10.1109/ICASSP.2010.5496295
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-03-14
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Automatic testing Automatic speech recognition Hidden Markov models Multimedia communication Acoustic testing Digital multimedia broadcasting TV broadcasting Delay Research and development Error correction frame-synchronous likelihood ratio test Automatically Synchronizing spoken Utterances with their Transcripts
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Real-time subtitle synchronization in live television programs

Automatic disfluency removal for improving spoken language translation

Speaking rate adaptation using continuous frame rate normalization

Joint maximum a posteriori estimation of transformation and hidden Markov model parameters

ERROR CORRECTION SCHEMES FOR DIGITAL TELEVISION BROADCASTING

Multimedia fusion in automatic extraction of studio speech segments for spoken document retrieval

Adaptive training using simple target models [speech recognition applications]

Robust frame synchronization scheme for the Chinese TDS-OFDM-based DTTB systems

Improving acoustic models with captioned multimedia speech

Automatic Synchronization of live speech and its Transcripts based on a frame-synchronous likelihood ratio test

Similar Documents

Real-time subtitle synchronization in live television programs

Automatic disfluency removal for improving spoken language translation

Speaking rate adaptation using continuous frame rate normalization

Joint maximum a posteriori estimation of transformation and hidden Markov model parameters

ERROR CORRECTION SCHEMES FOR DIGITAL TELEVISION BROADCASTING

Multimedia fusion in automatic extraction of studio speech segments for spoken document retrieval

Adaptive training using simple target models [speech recognition applications]

Robust frame synchronization scheme for the Chinese TDS-OFDM-based DTTB systems

Improving acoustic models with captioned multimedia speech

Automatic Synchronization of live speech and its Transcripts based on a frame-synchronous likelihood ratio test