Implicitpca: Implicitly-Proxied Parametric Encoding for Collision-Aware Garment Reconstruction

31 Pages Posted: 1 Mar 2023

See all articles by lan chen

lan chen

affiliation not provided to SSRN

Jie Yang

affiliation not provided to SSRN

Hongbo Fu

City University of Hong Kong

Xiaoxu Meng

affiliation not provided to SSRN

Weikai Chen

affiliation not provided to SSRN

Bo Yang

affiliation not provided to SSRN

Lin Gao

affiliation not provided to SSRN

Abstract

The emerging remote collaboration in a virtual environment calls for the need for high-fidelity 3D human reconstruction from single image.To deal with the challenges of cloth details and topologies, parametric models are widely used as explicit priors. While they often lack of fine details from the image.Neural implicit approaches generate accurate details but are typically limited to closed surfaces.In addition, physically correct reconstructions, e.g. collision-free, is crucial but often ignored in prior works.We present ImplicitPCA, a parametric SDF network that closely couples parametric encoding with implicit functions, to enjoy the fine details brought by implicit reconstruction while maintaining correct open surfaces.We introduce a fast collision-aware regression network to ensure physically-correct estimation.During inference, an iterative routine is applied to align the garment to the 2D landmarks and fit with the collision-aware cloth SDF.The experiments on the public dataset and in-the-wild images demonstrate our outperformance.

Keywords: Garment Reconstruction, Implicit and Explicit Representation, Collision Aware, Parameterized Generation, Optimization

Suggested Citation

chen, lan and Yang, Jie and Fu, Hongbo and Meng, Xiaoxu and Chen, Weikai and Yang, Bo and Gao, Lin, Implicitpca: Implicitly-Proxied Parametric Encoding for Collision-Aware Garment Reconstruction. Available at SSRN: https://ssrn.com/abstract=4374184 or http://dx.doi.org/10.2139/ssrn.4374184

Lan Chen

affiliation not provided to SSRN ( email )

No Address Available

Jie Yang (Contact Author)

affiliation not provided to SSRN ( email )

No Address Available

Hongbo Fu

City University of Hong Kong ( email )

Xiaoxu Meng

affiliation not provided to SSRN ( email )

No Address Available

Weikai Chen

affiliation not provided to SSRN ( email )

No Address Available

Bo Yang

affiliation not provided to SSRN ( email )

No Address Available

Lin Gao

affiliation not provided to SSRN ( email )

No Address Available

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
63
Abstract Views
177
Rank
624,555
PlumX Metrics