Paper Overview
- Field: AI / Embodied Learning
- Authors: Yunsong Zhou, Hangxu Liu, Xuekun Jiang
- Published: 2025-04-10
- arXiv: 2504.07080
- Policies trained on purely synthetic data achieve parity with real-data baselines at a 1:15 equivalence ratio.
- 90% zero-shot success rate in real-world deployment.
- 50% generalization gains over baselines.
Motivation
Robotic manipulation with deformable objects represents a data-intensive regime in embodied learning, where shape, contact, and topology co-evolve in ways that far exceed the variability of rigid objects. Although simulation promises relief from the cost of real-world data acquisition, prevailing sim-to-real pipelines remain rooted in rigid-body abstractions, producing mismatched geometry, fragile soft dynamics, and motion primitives poorly suited for cloth interaction. The authors posit that simulation fails not for being synthetic, but for being ungrounded.
Approach: SIM1
SIM1 is a physics-aligned real-to-sim-to-real data engine that grounds simulation in the physical world. Given limited demonstrations, the system:
1. Digitizes scenes into metric-consistent digital twins. 2. Calibrates deformable dynamics through elastic modeling. 3. Expands behaviors via diffusion-based trajectory generation with quality filtering.
This pipeline transforms sparse observations into scaled synthetic supervision with near-demonstration fidelity.
Results
Conclusion
These results validate physics-aligned simulation as scalable supervision for deformable manipulation and a practical pathway for data-efficient policy learning.
---
*Originally posted on zhichai.net, 2025-04-11.*