ETRO VUB
About ETRO  |  News  |  Events  |  Vacancies  |  Contact  
Home Research Education Industry Publications About ETRO

ETRO Publications

Full Details

Journal Publication

Learning to Estimate the Body Shape Under Clothing from a Single 3D Scan

This publication appears in: IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS

Authors: P. Hu, N. Nourbakhsh, V. Dadarlat and A. Munteanu

Publication Date: Aug. 2020


Abstract:

Estimating the 3D human body shape and pose under clothing is important for many applications, including virtualtry-on, non-contact body measurement, and avatar creation forvirtual reality. Existing body shape estimation methods formulatethis task as an optimization problem by fitting a parametric bodymodel to a single dressed-human scan or a sequence of dressedhuman meshes for a better accuracy. This is impractical for manyapplications that require fast acquisition such as gaming andvirtual try-on due to the expensive computation. In this paper, wepropose the first learning-based approach to estimate the humanbody shape under clothing from a single dressed-human scan,dubbed Body PointNet. The proposed Body PointNet operatesdirectly on raw point clouds and predicts the undressed body ina coarse-to-fine manner. Due to the nature of the data – alignedpaired dressed scans and undressed bodies and genusǂ manifoldmeshes (i.e. single-layer surfaces) – we face a major challenge oflacking training data. To address this challenge, we propose anovel method to synthesize the dressed-human pseudo-scans andcorresponding ground truth bodies. A new large-scale dataset,dubbed BUG (Body Under virtual Garments) is presented,employed for the learning task of body shape estimation from 3Ddressed-human scans. Comprehensive evaluations show that theproposed Body PointNet outperforms the state-of-the-art methodsin terms of both accuracy and running time.

Other Reference Styles
Current ETRO Authors

Dr. Pengpeng Hu

+32 (0)02 629 169

phu@etrovub.be

more info

Miss Nastaran Nourbakhsh

+32 (0)02 629 169

nknourba@etrovub.be

more info

Prof. Dr. Ir. Adrian Munteanu

+32 (0)02 629 168

acmuntea@etrovub.be

more info

Other Publications

• Journal publications

IRIS • LAMI • AVSP

• Conference publications

IRIS • LAMI • AVSP

• Book publications

IRIS • LAMI • AVSP

• Reports

IRIS • LAMI • AVSP

• Laymen publications

IRIS • LAMI • AVSP

• PhD Theses

Search ETRO Publications

Author:

Keyword:  

Type:








- Contact person

- IRIS

- AVSP

- LAMI

- Contact person

- Thesis proposals

- ETRO Courses

- Contact person

- Spin-offs

- Know How

- Journals

- Conferences

- Books

- Vacancies

- News

- Events

- Press

Contact

ETRO Department

info@etro.vub.ac.be

Tel: +32 2 629 29 30

©2020 • Vrije Universiteit Brussel • ETRO Dept. • Pleinlaan 2 • 1050 Brussels • Tel: +32 2 629 2930 (secretariat) • Fax: +32 2 629 2883 • WebmasterDisclaimer