Reconstruction of Colored Soft Deformable Objects Based on Self-Generated Template

Jituo Li,     Xinqi Liu,      Haijing Deng,      Tianwei Wang,      Guodong Lu,      Jin Wang

Zhejiang University

Computer Aided Design (CAD), 2022




In reconstructing soft objects under different deformation states with RGB-D sensors, the results usually suffer from incomplete geometries and textures due to self-occlusion, such as dynamic wrinkles on a garment. A priori template is usually used for addressing this issue, but it requires complex scanning and an elaborate setup. This paper proposes a new framework to reconstruct a deformable soft object with complete geometry and consistent texture by introducing an incremental-completion self-generated template (SGT). By building a non-rigid registration that combines geometry and optical flow features, the SGT is dynamically updated and completed by supplementing the information from each initial state model. Then the updated SGT is reversely deformed to each state to obtain a sequence of dynamic reconstructed results with consistent geometry. Furthermore, a consistent Markov random field is also proposed to constrain mesh models in different states to generate consistent texture and guide non-rigid deformation. Experimental results show that our method achieves multi-state highquality reconstruction effects, which provides a new solution for dynamically reconstructing colored soft objects.



Fig 1. Our Pipeline.




Fig 2. Fitting Mannequin.


Fig 3. Reconstruction results.


Fig 4. Reconstruction results.



Xinqi Liu, Jituo Li, Guodong Lu. "Reconstruction of Colored Soft Deformable Objects Based on Self-Generated Template". CAD 2022.


  author = {Jituo Li, Xinqi Liu, Haijing Deng, Guodong Lu and Jin Wang},
  title = {Reconstruction of Colored Soft Deformable Objects Based on Self-Generated Template},
  booktitle = {Computer Aided Design (CAD)},