3DBodyNet: fast reconstruction of 3D animatable human body shape from a single commodity depth camera

Abstract

Knowledge about individual body shape has numerous applications in various domains such as healthcare, fashion and personalized entertainment. Most of the depth based whole body scanners need multiple cameras surrounding the user and requiring the user to keep a canonical pose strictly during capturing depth images. These scanning devices are expensive and need professional knowledge for operation. In order to make 3D scanning as easy-to-use and fast as possible, there is a great demand to simplify the process and to reduce the hardware requirements. In this paper, we propose a deep learning algorithm, dubbed 3DBodyNet, to rapidly reconstruct the 3D shape of human bodies using a single commodity depth camera. As easy-to-use as taking a photo using a mobile phone, our algorithm only needs two depth images of the front-facing and back-facing bodies. The proposed algorithm has strong operability since it is insensitive to the pose and the pose variations between the two depth images. It can also reconstruct an accurate body shape for users under tight/loose clothing. Another advantage of our method is the ability to generate an animatable human body model. Extensive experimental results show that the proposed method enables robust and easy-to-use animatable human body reconstruction, and outperforms the state-of-the-art methods with respect to running time and accuracy.

Pengpeng Hu

Assistant Professor

Pengpeng Hu is currently an Assistant Professor with the Center for Computational Science and Mathematical Modeling, Coventry University, Coventry, U.K. He was a Senior Researcher with the Department of Electronics and Informatics, Vrije Universiteit Brussel (VUB), Brussels, Belgium. In 2016, he was a Visiting Scholar with the School of Informatics, Edinburgh University, Edinburgh, U.K. In 2017, he was a Post-Doctoral Fellow with the Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, U.K. Since 2018, he has been with VUB. His current research interests include biometrics, geometric deep learning, 3-D human body reconstruction, point cloud processing, and measurement.