NDLI: Cooperative patch-based 3D surface tracking

Content Provider	IEEE Xplore Digital Library
Author	Klaudiny, M. Hilton, A.
Copyright Year	2011
Abstract	This paper presents a novel dense motion capture technique which creates a temporally consistent mesh sequence from several calibrated and synchronised video sequences of a dynamic object. A surface patch model based on the topology of a user-specified reference mesh is employed to track the surface of the object over time. Multi-view 3D matching of surface patches using a novel cooperative minimisation approach provides initial motion estimates which are robust to large, rapid non-rigid changes of shape. A Laplacian deformation subsequently regularises the motion of the whole mesh using the weighted vertex displacements as soft constraints. An unregistered surface geometry independently reconstructed at each frame is incorporated as a shape prior to improve the quality of tracking. The method is evaluated in a challenging scenario of facial performance capture. Results demonstrate accurate tracking of fast, complex expressions over long sequences without use of markers or a pattern.
Starting Page	67
Ending Page	76
File Size	1044422
Page Count	10
File Format	PDF
ISBN	9781467301176
DOI	10.1109/CVMP.2011.14
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2011-11-16
Publisher Place	United Kingdom
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Geometry Dense motion capture Cooperative optimisation Laplace equations Shape Tracking Surface tracking Three dimensional displays Vectors Face Temporal alignment
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Facial motion capture with 3D active appearance models

Temporal Alignment of 3D Video Sequences Using Shape and Appearance

Multiscale 3D Feature Extraction and Matching

3D ear alignment based on geometry invariant

High-Detail 3D Capture and Non-sequential Alignment of Facial Performance

Using intrinsic surface geometry and absolute invariants for 3D face alignment and registration

3D face matching: An alignment approach using ordered facial surface patterns

A novel surface pattern for 3D facial surface encoding and alignment

Dense 3D face alignment from 2D videos in real-time

Cooperative patch-based 3D surface tracking

Similar Documents

Facial motion capture with 3D active appearance models

Temporal Alignment of 3D Video Sequences Using Shape and Appearance

Multiscale 3D Feature Extraction and Matching

3D ear alignment based on geometry invariant

High-Detail 3D Capture and Non-sequential Alignment of Facial Performance

Using intrinsic surface geometry and absolute invariants for 3D face alignment and registration

3D face matching: An alignment approach using ordered facial surface patterns

A novel surface pattern for 3D facial surface encoding and alignment

Dense 3D face alignment from 2D videos in real-time

Cooperative patch-based 3D surface tracking