Abstract
Accurate 3-D models of human subjects are widely used in domains such as fashion design, non-contact body biometrics, computer animation, gaming, AR/VR, to cite a few. For these kinds of applications, a high-fidelity human body mesh in a canonical posture (e.g. pose or pose) is necessary. This paper proposes a deep learning approach to jointly reconstruct a clean, watertight body mesh and to normalize the posture of the human body model starting from an input set of impaired body point clouds. The proposed method, dubbed Impaired-to-High-fidelity human body network (I2H) is, to the best of our knowledge, the first deep learning approach in the literature that addresses these problems. The proposed method follows an Encoder-Decoder design. The Encoder directly takes the impaired point clouds (e.g. containing noise, occlusions and misalignments) as input without making any structural assumptions about the input. The Decoder interprets the latent feature and produces a high-fidelity T-pose body mesh. We compare the proposed approach against existing state-of-the-art methods through various experiments and show that our method achieves the best performance on both synthetic and scanned datasets for 3D human mesh reconstruction.
Pengpeng Hu
Senior Lecturer (Associate Professor)
Pengpeng Hu is currently a Senior Lecturer (Associate Professor) with The University of Manchester. His research interests include biometrics, geometric deep learning, 3D human body reconstruction, point cloud processing, and vision-based measurement. He serves as an Associate Editor for IEEE Transactions on Neural Networks and Learning Systems, IEEE Transactions on Automation Science and Engineering, and Engineering and Mathematics in Medical and Life Sciences, as well as an Academic Editor for PLOS ONE and a member of the editorial board for Scientific Reports. He is also the Programme Chair for the 25th UK Workshop on Computational Intelligence (UKCI 2026) and an Area Chair for the 35th British Machine Vision Conference (BMVC 2024). He is the recipient of the Emerald Literati Award for an outstanding paper in 2019.