Paper Overview
Field: AI / Computer Vision Authors: Xiaoben Li, Jingyi Wu, Zeyu Cai Published: 2025-04-10 arXiv: 2504.07086
Abstract (Original)
Human body fitting, which aligns parametric body models such as SMPL to raw 3D point clouds of clothed humans, serves as a crucial first step for downstream tasks like animation and texturing. An effective fitting method should be both locally expressive—capturing fine details such as hands and facial features—and globally robust to handle real-world challenges, including clothing dynamics, pose variations, and noisy or partial inputs. Existing approaches typically excel in only one aspect, lacking an all-in-one solution.
We upgrade ETCH to ETCH-X, which leverages a tightness-aware fitting paradigm to filter out clothing dynamics ("undress"), extends expressiveness with SMPL-X, and replaces explicit sparse markers (which are highly sensitive to partial data) with implicit dense correspondences ("dense fit") for more robust and fine-grained body fitting.
Our disentangled "undress" and "dense fit" modular stages enable separate and scalable training on composable data sources, including diverse simulated garments (CLOTH3D), large-scale full-body motions (AMASS), and fine-grained hand gestures (InterHand2.6M), improving outfit generalization and pose robustness of both bodies and hands.
Key Results
ETCH-X achieves robust and expressive fitting across diverse clothing, poses, and levels of input completeness, with substantial improvements over ETCH on:
- Seen data: 4D-Dress (MPJPE-All reduced by 33.0%) and CAPE (V2V-Hands reduced by 35.8%)
- Unseen data: BEDLAM2.0 (MPJPE-All reduced by 80.8%; V2V-All reduced by 80.5%)
- "Undress" stage: tightness-aware fitting paradigm that filters out clothing dynamics
- SMPL-X extension: adds expressiveness for hands and face
- "Dense fit" stage: implicit dense correspondences replace explicit sparse markers, which are highly sensitive to partial data
- Composable training: modular stages can be trained separately on scalable data sources (CLOTH3D, AMASS, InterHand2.6M)