NDLI: Touchable 3D video system

Please wait, while we are loading the content...

Touchable 3D video system

Content Provider	ACM Digital Library
Author	Saddik, Abdulmotaleb El Cha, Jongeun Eid, Mohamad
Copyright Year	2009
Abstract	Multimedia technologies are reaching the limits of providing audio-visual media that viewers consume passively. An important factor, which will ultimately enhance the user's experience in terms of impressiveness and immersion, is interaction. Among daily life interactions, haptic interaction plays a prominent role in enhancing the quality of experience of users, and in promoting physical and emotional development. Therefore, a critical step in multimedia research is expected to bring the sense of touch, or haptics, into multimedia systems and applications. This article proposes a touchable 3D video system where viewers can actively touch a video scene through a force-feedback device, and presents the underlying technologies in three functional components: (1) contents generation, (2) contents transmission, and (3) viewing and interaction. First of all, we introduce a depth image-based haptic representation (DIBHR) method that adds haptic and heightmap images, in addition to the traditional depth image-based representation (DIBR), to encode the haptic surface properties of the video media. In this representation, the haptic image contains the stiffness, static friction, and dynamic friction, whereas the heightmap image contains roughness of the video contents. Based on this representation method, we discuss how to generate synthetic and natural (real) video media through a 3D modeling tool and a depth camera, respectively. Next, we introduce a transmission mechanism based on the MPEG-4 framework where new MPEG-4 BIFS nodes are designed to describe the haptic scene. Finally, a haptic rendering algorithm to compute the interaction force between the scene and the viewer is described. As a result, the performance of the haptic rendering algorithm is evaluated in terms of computational time and smooth contact force. It operates marginally within a 1 kHz update rate that is required to provide stable interaction force and provide smoother contact force with the depth image that has high frequency geometrical noise using a median filter.
Starting Page	1
Ending Page	25
Page Count	25
File Format	PDF
ISSN	15516857
e-ISSN	15516865
DOI	10.1145/1596990.1596993
Volume Number	5
Issue Number	4
Journal	ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2009-11-06
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Haptic surface properties Haptic rendering algorithm Video representation
Content Type	Text
Resource Type	Article
Subject	Hardware and Architecture Computer Networks and Communications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Modeling context in haptic perception, rendering, and visualization

Spider: A system for finding 3D video copies

QoE-oriented 3D video transcoding for mobile streaming

A real-time remote rendering system for interactive mobile graphics

6DoF haptic rendering using distance maps over implicit representations

Human perception of haptic-to-video and haptic-to-audio skew in multimedia applications

Slingshot 3D: A synchronous haptic-audio-video game

A novel 3D video transcoding scheme for adaptive 3D video transmission to heterogeneous terminals

Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments (TOMM, Vol.9, Issue 4)

Touchable 3D video system

Similar Documents

Modeling context in haptic perception, rendering, and visualization

Spider: A system for finding 3D video copies

QoE-oriented 3D video transcoding for mobile streaming

A real-time remote rendering system for interactive mobile graphics

6DoF haptic rendering using distance maps over implicit representations

Human perception of haptic-to-video and haptic-to-audio skew in multimedia applications

Slingshot 3D: A synchronous haptic-audio-video game

A novel 3D video transcoding scheme for adaptive 3D video transmission to heterogeneous terminals

Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments (TOMM, Vol.9, Issue 4)

Touchable 3D video system