NDLI: On the Design and Prototype Implementation of a Multimodal Situation Aware System

Content Provider	IEEE Xplore Digital Library
Author	Hegde, R.M. Kurniawan, J. Rao, B.D.
Copyright Year	1999
Abstract	In this paper we describe the design concepts and prototype implementation of a situation aware ubiquitous computing system using multiple modalities such as National Marine Electronics Association (NMEA) data from Global Positioning System (GPS) receivers, text, speech, environmental audio, and handwriting inputs. While most mobile and communication devices know where and who they are, by accessing context information primarily in the form of location, time stamps, and user identity, the concept of sharing of this information in a reliable and intelligent fashion is crucial in many scenarios. A framework which takes the concept of context aware computing to the level of situation aware computing by intelligent information exchange between context aware devices is designed and implemented in this work. Four sensual modes of contextual information like text, speech, environmental audio, and handwriting are augmented to conventional contextual information sources like location from GPS, user identity based on IP addresses (IPA), and time stamps. Each device derives its context not necessarily using the same criteria or parameters but by employing selective fusion and fission of multiple modalities. The processing of each individual modality takes place at the client device followed by the summarization of context as a text file. Exchange of dynamic context information between devices is enabled in real time to create multimodal situation aware devices. A central repository of all user context profiles is also created to enable self-learning devices in the future. Based on the results of simulated situations and real field deployments it is shown that the use of multiple modalities like speech, environmental audio, and handwriting inputs along with conventional modalities can create devices with enhanced situational awareness.
Sponsorship	IEEE Signal Processing Society IEEE Circuits and Systems Society IEEE Communications Society IEEE Computer Society
Starting Page	645
Ending Page	657
Page Count	13
File Size	1857556
File Format	PDF
ISSN	15209210
Volume Number	11
Issue Number	4
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-06-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Prototypes Context awareness Ubiquitous computing Global Positioning System Humans Mobile communication Computational modeling Speech enhancement Speech recognition ubiquitous computing Bidirectional FTP synchronization environmental audio GPS speech recognition
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering Computer Science Applications Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A User-centered Approach to Context-awareness in Mobile Computing

ContextPhone: a prototyping platform for context-aware mobile applications

Group knowledge management for context-aware group applications and services

Context-based services discovery in mobile environments

Multimodal user interfaces for context-aware mobile applications

TRAcME: Temporal Activity Recognition Using Mobile Phone Data

What GPS doesn't tell you: determining one's context with low-level sensors

Bigraphical Model of Context-Aware in Ubiquitous Computing Environments

Positioning Techniques for Ubiquitous Ecological Learning

On the Design and Prototype Implementation of a Multimodal Situation Aware System

Similar Documents

A User-centered Approach to Context-awareness in Mobile Computing

ContextPhone: a prototyping platform for context-aware mobile applications

Group knowledge management for context-aware group applications and services

Context-based services discovery in mobile environments

Multimodal user interfaces for context-aware mobile applications

TRAcME: Temporal Activity Recognition Using Mobile Phone Data

What GPS doesn't tell you: determining one's context with low-level sensors

Bigraphical Model of Context-Aware in Ubiquitous Computing Environments

Positioning Techniques for Ubiquitous Ecological Learning

On the Design and Prototype Implementation of a Multimodal Situation Aware System