NDLI: Activity analysis enabling real-time video communication on mobile phones for deaf users

Please wait, while we are loading the content...

Interactive viscosity

Ripples: utilizing per-contact visualizations to improve user interaction with touch displays

Mouse 2.0: multi-touch meets the mouse

EverybodyLovesSketch: 3D sketching for a broader audience

Activity analysis enabling real-time video communication on mobile phones for deaf users

Disappearing mobile devices

Bonfire: a nomadic system for hybrid laptop-tabletop interaction

Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines

The rise of the expert amateur: DIY culture and citizen science

Sikuli: using GUI screenshots for search and automation

Relaxed selection techniques for querying time-series graphs

Changing how people view changes on the web

Contact area interaction with sliding widgets

PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity

A screen-space formulation for 2D and 3D direct manipulation

User guided audio selection from complex sound mixtures

SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices

Interactions in the air: adding further depth to interactive tabletops

Enabling always-available input with muscle-computer interfaces

CommunityCommands: command recommendations for software applications

Integrated videos and maps for driving directions

Overview based example selection in end user interactive concept learning

Detecting and leveraging finger orientation for interaction with direct-touch surfaces

A reconfigurable ferromagnetic input device

TapSongs: tapping rhythm-based passwords on a single binary sensor

Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices

Augmenting interactive tables with mice & keyboards

Optically sensing tongue gestures for computer input

Mining web interactions to automatically create mash-ups

Perceptual interpretation of ink annotations on line charts

The web page as a WYSIWYG end-user customizable database-backed information management application

A practical pressure sensitive computer keyboard

Collabio: a game for annotating people within social networks

Virtual shelves: interactions with orientation aware devices

ARC-Pad: absolute+relative cursor positioning for large displays with a mobile touchscreen

Activity analysis enabling real-time video communication on mobile phones for deaf users

Content Provider	ACM Digital Library
Author	Chon, Jaehong Wobbrock, Jacob O. Riskin, Eve A. Cherniavsky, Neva Ladner, Richard E.
Abstract	We describe our system called MobileASL for real-time video communication on the current U.S. mobile phone network. The goal of MobileASL is to enable Deaf people to communicate with Sign Language over mobile phones by compressing and transmitting sign language video in real-time on an off-the-shelf mobile phone, which has a weak processor, uses limited bandwidth, and has little battery capacity. We develop several H.264-compliant algorithms to save system resources while maintaining ASL intelligibility by focusing on the important segments of the video. We employ a dynamic skin-based region-of-interest (ROI) that encodes the skin at higher quality at the expense of the rest of the video. We also automatically recognize periods of signing versus not signing and raise and lower the frame rate accordingly, a technique we call variable frame rate (VFR). We show that our variable frame rate technique results in a 47% gain in battery life on the phone, corresponding to an extra 68 minutes of talk time. We also evaluate our system in a user study. Participants fluent in ASL engage in unconstrained conversations over mobile phones in a laboratory setting. We find that the ROI increases intelligibility and decreases guessing. VFR increases the need for signs to be repeated and the number of conversational breakdowns, but does not affect the users' perception of adopting the technology. These results show that our sign language sensitive algorithms can save considerable resources without sacrificing intelligibility.
Starting Page	79
Ending Page	88
Page Count	10
File Format	PDF
ISBN	9781605587455
DOI	10.1145/1622176.1622192
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2009-10-04
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Mobileasl Computer vision Sign language Region-of-interest Variable frame rate Video compression
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in