NDLI: Real-time full-body motion reconstruction and recognition for off-the-shelf VR devices

Please wait, while we are loading the content...

SAVE: shared augmented virtual environment for real-time mixed reality applications

An inverse rendering approach for heterogeneous translucent materials

Rectangular stable power-aware mobile projection on planar surfaces

A two-dimensional editing system based on hand gestures and real object manipulation using RGB-D sensor

MDIS cloth system: virtual reality technology for firefighter training

A novel method for short-time human activity recognition based on improved template matching technique

Crowd formation via hierarchical planning

Real-time human action recognition using individual body part locations and local joints structure

Haptic mirror: a platform for active exploration of facial expressions and social interaction by individuals who are blind

Interactive modeling and editing of free-form surfaces from curve networks

Position based balloon angioplasty

Visualizing brightness temperature data of king crater area with CELMS

VRMController: an input device for navigation activities in virtual reality environments

Passive haptics based MR system for geography teaching

Motion simulation of wet cloth on contact surface considering air effects and humidity

Research on simulation system of welding robot in Unity3d

DovCut: a draft based online video compositing system

Modeling and simulation of the trawl in fishing simulator

VR locomotion: walking > walking in place > arm swinging

Automated brain extraction and associated 3D inspection layers for the Rhesus macaque MRI datasets

Real-time video stylization using spatial-temporal gabor filtering

A novel bagged particle filter for object tracking

Gap connection of vascular branches by nonlinear least squares curve fitting algorithm

An improved ANN search algorithm for visual search applications

Illumination invariant mesh coloring

Glance: generalized geometric primitives and transformations for information visualization in AR/VR environments

Mixed reality based interaction system for digital heritage

A framework of face synthesis based on multilinear analysis

Semantic framework for interactive animation generation

Geodesic histogram based 3D deformable shape correspondence

Real-time full-body motion reconstruction and recognition for off-the-shelf VR devices

User guided 3D scene enrichment

Virtual reality technology based developmental designs of multiplayer-interaction-supporting exhibits of science museums: taking the exhibit of "virtual experience on an aircraft carrier" in China science and technology museum as an example

An automatic positioning algorithm for archaeological fragments

Evaluating virtual reality experience and performance: a brain based approach

FPGA design & implementation of a very-low-latency video-see-through (VLLV) head-mount display (HMD) system for mixed reality (MR) applications

Quad-tree spatial index for dynamic allocation of sea ice modeling in ice navigation simulator

Interaction in marker-less augmented reality based on hand detection using leap motion

Making decision for the next step in dense crowd simulation using support vector machines

Automatic planar shape segmentation from indoor point clouds

Short-time activity recognition with wearable sensors using convolutional neural network

Research on camouflage effect evaluation method of moving object based on video

Facial expressions recognition based on convolutional neural networks for mobile virtual reality

Real-time head pose estimation for driver assistance system using low-cost on-board computer

A mesh-insensitive elastic model for simulation of solid bodies

Simulating group formation and behaviour in dense crowd

Point cloud registration by discrete spin image and normal alignment radial feature

An accurate multi-sensor fusion measurement method for marker-free augmented reality system

Temporal clustering of motion capture data with optimal partitioning

A mixed-reality museum tourism framework based on HMD and fisheye camera

A small scene assistant maintenance system based on optical see-through augmented reality

An immersive approach to the visual exploration of geospatial network datasets

A bio-inspired image local feature representation based on vision network model

Real-time full-body motion reconstruction and recognition for off-the-shelf VR devices

Content Provider	ACM Digital Library
Author	Yang, Xubo Jiang, Fan Feng, Lele
Abstract	Almost all VR multi-person applications have the requirement of reconstructing the whole-body motions in real-time in order to create deeper immersion. In fact, if we can ensure that the motion we reconstruct is natural, we can improve upon the comfort and number of wearing sensors at the cost of reconstruction precision because all users in VR are blindfolded. In this paper, we introduce a novel real-time motion reconstruction and recognition method in VR only using the positions and orientations of user's head and two hands. To reconstruct natural motions according to rare sensors, we divide the whole body into the upper body and the lower body. The upper body reconstruction algorithm based on inverse kinematics which is more accurate and the lower body based on animation blending which only needs a small number of prepared animations. Meanwhile, a natural action recognition algorithm based on neural network will run in need to detect the target motions we have trained. We show that our method can reconstruct various full-body motions, such as walking in any direction, jogging, jumping, crouching and turning. Our method has the ability to reconstruct natural human motions which can be used in almost all VR multi-person interactive applications. The configuration of sensors we attached on the head and hands is very popular in VR well-known devices, so the method can be easily integrated into off-the-shelf VR devices.
Starting Page	309
Ending Page	318
Page Count	10
File Format	PDF
ISBN	9781450346924
DOI	10.1145/3013971.3013987
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-12-03
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Real-time Vr Full-body motion reconstruction Motion recongnition
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in