NDLI: New multi-view human motion capture framework

Content Provider	IET Digital Library
Author	Wang, Yuan Xu, Feiyi Pun, Chi Man Xiao, Wenqi Nie, Jianhui Xiong, Jian Gao, Hao Xu, Feng
Abstract	Estimating human pose and shape without markers is a challenging problem. This study proposes a multiple-view markerless human motion capture framework. Firstly, a multi-view camera system is built for capturing real-time images of moving humans on multiple views. Secondly, by employing the OpenPose method, the authors calculate robust 3D key points from 2D key points of the human body, which are estimated from the multi-view images. And dense 3D point cloud is reconstructed from images. Thirdly, they propose a novel SMPL-based method to represent human motion by fitting the SMPL model to 3D key points and 3D point clouds. In order to achieve a more accurate human pose, a penalty term is utilised to solve the problem of error accumulation in the process of human motion capture. In addition, they present a dense mesh template-based SMPL that can be deformed to point cloud to recover a real human body shape. Finally, they map multi-view colour images onto the human mesh model to acquire rendered mesh. The experimental results show that the proposed method improves the accuracy of human pose and realises the 3D human body model more realistic.
Starting Page	2668
Ending Page	2674
Page Count	7
ISSN	17519659
Volume Number	14
e-ISSN	17519667
Issue Number	Issue 12, Oct (2020)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/iet-ipr/14/12
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/iet-ipr.2019.1606
Journal	IET Image Processing
Publisher Date	2020-04-15
Access Restriction	Open
Rights Holder	© The Institution of Engineering and Technology
Subject Keyword	2D Key Points 3D Point Cloud Computer Vision And Image Processing Technique Human Body Human Motion Capture Human Pose Estimation Image Capture Image Colour Analysis Image Motion Analysis Image Reconstruction Multiview Camera System Multiview Colour Image Multiview Human Motion Capture Framework Novel SMPL-based Method Optical, Image And Video Signal Processing Real-time Image Capturing Robust 3D Key Point SMPL Model
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Human pose estimation method based on single depth image

3D driver pose estimation based on joint 2D–3D network

High Quality Reconstruction of Dynamic Objects using 2D-3D Camera Fusion

3D Reconstruction of Dynamic Vehicles using Sparse 3D-Laser-Scanner and 2D Image Fusion

Coupling dense point cloud correspondence and template model fitting for 3D human pose and shape reconstruction from a single depth image

On 3D Reconstruction Using RGB-D Cameras

3D Reconstruction of Dynamic Vehicles using Sparse 3D-Laser-Scanner and 2D Image Fusion

Geometric error correction of convergent multi-view images

Efficient human motion capture data annotation via multi-view spatiotemporal feature fusion

New multi-view human motion capture framework

Similar Documents

Human pose estimation method based on single depth image

3D driver pose estimation based on joint 2D–3D network

High Quality Reconstruction of Dynamic Objects using 2D-3D Camera Fusion

3D Reconstruction of Dynamic Vehicles using Sparse 3D-Laser-Scanner and 2D Image Fusion

Coupling dense point cloud correspondence and template model fitting for 3D human pose and shape reconstruction from a single depth image

On 3D Reconstruction Using RGB-D Cameras

3D Reconstruction of Dynamic Vehicles using Sparse 3D-Laser-Scanner and 2D Image Fusion

Geometric error correction of convergent multi-view images

Efficient human motion capture data annotation via multi-view spatiotemporal feature fusion

New multi-view human motion capture framework