ETCH-X: Robustify Expressive Body Fitting to Clothed Humans
Field: Computer Vision Authors: Xiaoben Li, Jingyi Wu, Zeyu Cai arXiv: 2504.07950
Abstract
Human body fitting, which aligns parametric body models such as SMPL to raw 3D point clouds of clothed humans, serves as a crucial first step for downstream tasks like animation and texturing. An effective fitting method should be both locally expressive—capturing fine details such as hands and facial features—and globally robust to handle real-world challenges, including clothing dynamics, pose variations, and noisy or partial inputs. Existing approaches typically excel in only one aspect, lacking an all-in-one solution.
We upgrade ETCH to ETCH-X, which leverages a tightness-aware fitting paradigm to filter out clothing dynamics ("undress"), extends expressiveness with SMPL-X, and replaces explicit sparse markers—which are highly sensitive to partial data—with implicit dense correspondences ("dense fit"), enabling more robust and fine-grained human body fitting.
Our decoupled "undress" and "dense fit" modular stages support scalable training on composable data sources, including diverse simulated garments (CLOTH3D), large-scale full-body motion (AMASS), and fine-grained hand gestures (InterHand2.6M), improving garment generalization and pose robustness for both body and hands.
Results
ETCH-X achieves robust and expressive fitting under diverse clothing, poses, and input completeness levels, with significant improvements over ETCH:
- Seen datasets:
- 4D-Dress: MPJPE-All improved by 33.0%
- CAPE: V2V-Hands improved by 35.8%
- Unseen dataset:
- BEDLAM2.0: MPJPE-All improved by 80.8%, V2V-All improved by 80.5%
- Paper: https://arxiv.org/abs/2504.07950