NDLI: Achieving eye contact in a one-to-many 3D video teleconferencing system

Content Provider	ACM Digital Library
Author	Fyffe, Graham Busch, Jay Yu, Xueming Lang, Magnus Mcdowall, Ian Bolas, Mark Jones, Andrew Debevec, Paul
Copyright Year	2009
Abstract	We present a set of algorithms and an associated display system capable of producing correctly rendered eye contact between a three-dimensionally transmitted remote participant and a group of observers in a 3D teleconferencing system. The participant's face is scanned in 3D at 30Hz and transmitted in real time to an autostereoscopic horizontal-parallax 3D display, displaying him or her over more than a 180° field of view observable to multiple observers. To render the geometry with correct perspective, we create a fast vertex shader based on a 6D lookup table for projecting 3D scene vertices to a range of subject angles, heights, and distances. We generalize the projection mathematics to arbitrarily shaped display surfaces, which allows us to employ a curved concave display surface to focus the high speed imagery to individual observers. To achieve two-way eye contact, we capture 2D video from a cross-polarized camera reflected to the position of the virtual participant's eyes, and display this 2D video feed on a large screen in front of the real participant, replicating the viewpoint of their virtual self. To achieve correct vertical perspective, we further leverage this image to track the position of each audience member's eyes, allowing the 3D display to render correct vertical perspective for each of the viewers around the device. The result is a one-to-many 3D teleconferencing system able to reproduce the effects of gaze, attention, and eye contact generally missing in traditional teleconferencing systems.
Starting Page	1
Ending Page	8
Page Count	8
File Format	PDF
ISSN	07300301
e-ISSN	15577368
DOI	10.1145/1531326.1531370
Volume Number	28
Issue Number	3
Journal	ACM Transactions on Graphics (TOG)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2009-07-27
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Achieving eye contact in a one-to-many 3D video teleconferencing system

Content-preserving warps for 3D video stabilization

The Usable Intersection of PC Graphics and NTSC Video Recording

Creating 3D real time video games

A video adjunt to transactions on graphics

blue-c: a spatially immersive display and 3D video portal for telepresence

Alice:easy to learn interactive 3D graphics

Realtime 3D eye gaze animation using a single RGB camera

Interaction in 3d graphics

Achieving eye contact in a one-to-many 3D video teleconferencing system

Similar Documents

Achieving eye contact in a one-to-many 3D video teleconferencing system

Content-preserving warps for 3D video stabilization

The Usable Intersection of PC Graphics and NTSC Video Recording

Creating 3D real time video games

A video adjunt to transactions on graphics

blue-c: a spatially immersive display and 3D video portal for telepresence

Alice:easy to learn interactive 3D graphics

Realtime 3D eye gaze animation using a single RGB camera

Interaction in 3d graphics

Achieving eye contact in a one-to-many 3D video teleconferencing system