NDLI: Facial expressions recognition based on convolutional neural networks for mobile virtual reality

Please wait, while we are loading the content...

SAVE: shared augmented virtual environment for real-time mixed reality applications

An inverse rendering approach for heterogeneous translucent materials

Rectangular stable power-aware mobile projection on planar surfaces

A two-dimensional editing system based on hand gestures and real object manipulation using RGB-D sensor

MDIS cloth system: virtual reality technology for firefighter training

A novel method for short-time human activity recognition based on improved template matching technique

Crowd formation via hierarchical planning

Real-time human action recognition using individual body part locations and local joints structure

Haptic mirror: a platform for active exploration of facial expressions and social interaction by individuals who are blind

Interactive modeling and editing of free-form surfaces from curve networks

Position based balloon angioplasty

Visualizing brightness temperature data of king crater area with CELMS

VRMController: an input device for navigation activities in virtual reality environments

Passive haptics based MR system for geography teaching

Motion simulation of wet cloth on contact surface considering air effects and humidity

Research on simulation system of welding robot in Unity3d

DovCut: a draft based online video compositing system

Modeling and simulation of the trawl in fishing simulator

VR locomotion: walking > walking in place > arm swinging

Automated brain extraction and associated 3D inspection layers for the Rhesus macaque MRI datasets

Real-time video stylization using spatial-temporal gabor filtering

A novel bagged particle filter for object tracking

Gap connection of vascular branches by nonlinear least squares curve fitting algorithm

An improved ANN search algorithm for visual search applications

Illumination invariant mesh coloring

Glance: generalized geometric primitives and transformations for information visualization in AR/VR environments

Mixed reality based interaction system for digital heritage

A framework of face synthesis based on multilinear analysis

Semantic framework for interactive animation generation

Geodesic histogram based 3D deformable shape correspondence

Real-time full-body motion reconstruction and recognition for off-the-shelf VR devices

User guided 3D scene enrichment

Virtual reality technology based developmental designs of multiplayer-interaction-supporting exhibits of science museums: taking the exhibit of "virtual experience on an aircraft carrier" in China science and technology museum as an example

An automatic positioning algorithm for archaeological fragments

Evaluating virtual reality experience and performance: a brain based approach

FPGA design & implementation of a very-low-latency video-see-through (VLLV) head-mount display (HMD) system for mixed reality (MR) applications

Quad-tree spatial index for dynamic allocation of sea ice modeling in ice navigation simulator

Interaction in marker-less augmented reality based on hand detection using leap motion

Making decision for the next step in dense crowd simulation using support vector machines

Automatic planar shape segmentation from indoor point clouds

Short-time activity recognition with wearable sensors using convolutional neural network

Research on camouflage effect evaluation method of moving object based on video

Facial expressions recognition based on convolutional neural networks for mobile virtual reality

Real-time head pose estimation for driver assistance system using low-cost on-board computer

A mesh-insensitive elastic model for simulation of solid bodies

Simulating group formation and behaviour in dense crowd

Point cloud registration by discrete spin image and normal alignment radial feature

An accurate multi-sensor fusion measurement method for marker-free augmented reality system

Temporal clustering of motion capture data with optimal partitioning

A mixed-reality museum tourism framework based on HMD and fisheye camera

A small scene assistant maintenance system based on optical see-through augmented reality

An immersive approach to the visual exploration of geospatial network datasets

A bio-inspired image local feature representation based on vision network model

Facial expressions recognition based on convolutional neural networks for mobile virtual reality

Content Provider	ACM Digital Library
Author	Yang, Xubo Teng, Teng
Abstract	We present a new system designed for enabling direct face-to-face interaction for users wearing a head-mounted displays (HMD) in virtual reality environment. Due to HMD's occlusion of a user's face, VR applications and games are mainly designed for single user. Even in some multi-player games, players can only communicate with each other using audio input devices or controllers. To address this problem, we develop a novel system that allows users to interact with each other using facial expressions in real-time. Our system consists of two major components: an automatic tracking and segmenting face processing component and a facial expressions recognizing component based on convolutional neural networks (CNN). First, our system tracks a specific marker on the front surface of the HMD and then uses the extracted spatial data to estimate face positions and rotations for mouth segmentation. At last, with the help of an adaptive approach for histogram based mouth segmentation [Panning et al. 2009], our system passes the processed lips pixels' information to CNN and get the facial expressions results in real-time. The results of our experiments show that our system can effectively recognize the basic expressions of users.
Starting Page	475
Ending Page	478
Page Count	4
File Format	PDF
ISBN	9781450346924
DOI	10.1145/3013971.3014025
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-12-03
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Digital image process Virtual reality Mobile application Convolutional neural networks Expressions recognition
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in