NDLI: Modeling of Speaking Rate Influences on Mandarin Speech Prosody and Its Application to Speaking Rate-controlled TTS

Please wait, while we are loading the content...

Modeling of Speaking Rate Influences on Mandarin Speech Prosody and Its Application to Speaking Rate-controlled TTS

Content Provider	IEEE Xplore Digital Library
Author	Sin-Horng Chen Chiao-Hua Hsieh Chen-Yu Chiang Hsi-Chun Hsiao Yih-Ru Wang Yuan-Fu Liao Hsiu-Min Yu
Copyright Year	2014
Abstract	A new data-driven approach to building a speaking rate-dependent hierarchical prosodic model (SR-HPM), directly from a large prosody-unlabeled speech database containing utterances of various speaking rates, to describe the influences of speaking rate on Mandarin speech prosody is proposed. It is an extended version of the existing HPM model which contains 12 sub-models to describe various relationships of prosodic-acoustic features of speech signal, linguistic features of the associated text, and prosodic tags representing the prosodic structure of speech. Two main modifications are suggested. One is designing proper normalization functions from the statistics of the whole database to compensate the influences of speaking rate on all prosodic-acoustic features. Another is modifying the HPM training to let its parameters be speaking-rate dependent. Experimental results on a large Mandarin read speech corpus showed that the parameters of the SR-HPM together with these feature normalization functions interpreted the effects of speaking rate on Mandarin speech prosody very well. An application of the SR-HPM to design and implement a speaking rate-controlled Mandarin TTS system is demonstrated. The system can generate natural synthetic speech for any given speaking rate in a wide range of 3.4-6.8 syllables/sec. Two subjective tests, MOS and preference test, were conducted to compare the proposed system with the popular HTS system. The MOS scores of the proposed system were in the range of 3.58-3.83 for eight different speaking rates, while they were in 3.09-3.43 for HTS. Besides, the proposed system had higher preference scores (49.8%-79.6%) than those (9.8%-30.7%) of HTS. This confirmed the effectiveness of the speaking rate control method of the proposed TTS system.
Starting Page	1158
Ending Page	1171
Page Count	14
File Size	3459152
File Format	PDF
ISSN	23299290
Volume Number	22
Issue Number	7
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech Standards Databases Training Pragmatics Speech processing IEEE transactions speaking rate-controlled TTS Mandarin prosody modeling speaking rate modeling
Content Type	Text
Resource Type	Article
Subject	Acoustics and Ultrasonics Signal Processing Instrumentation Speech and Hearing Electrical and Electronic Engineering Computational Mathematics Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Modeling of speaking rate influences on mandarin speech prosody and its application to speaking rate-controlled TTS

A speaking rate-controlled Mandarin TTS system

A New Prosody-Assisted Mandarin ASR System

Speaker Adaptive Training of Deep Neural Network Acoustic Models Using I-Vectors

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

Modeling of Speaking Rate Influences on Mandarin Speech Prosody and Its Application to Speaking Rate-controlled TTS

Similar Documents

Modeling of speaking rate influences on mandarin speech prosody and its application to speaking rate-controlled TTS

A speaking rate-controlled Mandarin TTS system

A New Prosody-Assisted Mandarin ASR System

Speaker Adaptive Training of Deep Neural Network Acoustic Models Using I-Vectors

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

IEEE/ACM Transactions on Audio, Speech, and Language Processing Edics

Modeling of Speaking Rate Influences on Mandarin Speech Prosody and Its Application to Speaking Rate-controlled TTS