NDLI: Distributed speech processing in miPad's multimodal user interface

Please wait, while we are loading the content...

Distributed speech processing in miPad's multimodal user interface

Content Provider	IEEE Xplore Digital Library
Author	Li Deng Kuansan Wang Acero, A. Hsiao-Wuen Hon Droppo, J. Boulis, C. Ye-Yi Wang Jacoby, D. Mahajan, M. Chelba, C. Huang, X.D.
Copyright Year	1993
Abstract	This paper describes the main components of MiPad (multimodal interactive PAD) and especially its distributed speech processing aspects. MiPad is a wireless mobile PDA prototype that enables users to accomplish many common tasks using a multimodal spoken language interface and wireless-data technologies. It fully integrates continuous speech recognition and spoken language understanding, and provides a novel solution for data entry in PDAs or smart phones, often done by pecking with tiny styluses or typing on minuscule keyboards. Our user study indicates that the throughput of MiPad is significantly superior to that of the existing pen-based PDA interface. Acoustic modeling and noise robustness in distributed speech recognition are key components in MiPad's design and implementation. In a typical scenario, the user speaks to the device at a distance so that he or she can see the screen. The built-in microphone thus picks up a lot of background noise, which requires MiPad be noise robust. For complex tasks, such as dictating e-mails, resource limitations demand the use of a client-server (peer-to-peer) architecture, where the PDA performs primitive feature extraction, feature quantization, and error protection, while the transmitted features to the server are subject to further speech feature enhancement, speech decoding and understanding before a dialog is carried out and actions rendered. Noise robustness can be achieved at the client, at the server or both. Various speech processing aspects of this type of distributed computation as related to MiPad's potential deployment are presented. Previous user interface study results are also described. Finally, we point out future research directions as related to several key MiPad functionalities.
Starting Page	605
Ending Page	619
Page Count	15
File Size	1790518
File Format	PDF
ISSN	10636676
Volume Number	10
Issue Number	8
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2002-11-01
Publisher Place	U.S.A.
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech processing User interfaces Personal digital assistants Noise robustness Natural languages Speech recognition Background noise Feature extraction Speech enhancement Atherosclerosis
Content Type	Text
Resource Type	Article
Subject	Acoustics and Ultrasonics Electrical and Electronic Engineering Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A speech-centric perspective for human-computer interface

BLENDING SPEECH AND VISUAL INPUT IN MULTIMODAL DIALOGUE SYSTEMS

Distributed Speech Processing in MiPad's Multimodal User Interface (2002)

MiPad: a multimodal interaction prototype

Noise robust speech parameterization using multiresolution feature extraction

Robust speech recognition in noisy environments based on subband spectral centroid histograms

MATCH: multimodal access to city help

Speech analysis and segmentation by parametric filtering

Gulliver-A Framework for Building Smart Speech-Based Applications

Distributed speech processing in miPad's multimodal user interface

Similar Documents

A speech-centric perspective for human-computer interface

BLENDING SPEECH AND VISUAL INPUT IN MULTIMODAL DIALOGUE SYSTEMS

Distributed Speech Processing in MiPad's Multimodal User Interface (2002)

MiPad: a multimodal interaction prototype

Noise robust speech parameterization using multiresolution feature extraction

Robust speech recognition in noisy environments based on subband spectral centroid histograms

MATCH: multimodal access to city help

Speech analysis and segmentation by parametric filtering

Gulliver-A Framework for Building Smart Speech-Based Applications

Distributed speech processing in miPad's multimodal user interface