Paper Overview
Research Area: Computer Vision / Robotics (CV) Authors: Dihong Huang, Zhenyu Wei, Zhuxiu Xu Published: 2026-06-26 arXiv: 2606.28323
Abstract
Dexterous manipulation policies can solve individual skills, but composing them to perform multiple tasks with a single hand remains challenging. Adding a new task on top of an existing manipulation skill often imposes conflicting demands on overlapping fingers and contact modes, causing destructive interference between preserving an existing manipulation outcome and executing a new one. We propose DexCompose, a role-aware residual composition framework that reuses pretrained dexterous policies for multi-task manipulation through explicit finger-level action ownership.
How It Works
Given two pretrained full-hand policies:
1. Finger ownership identification — DexCompose collects successful post-task states from the first skill and performs release tests over candidate finger masks to identify which fingers are necessary for maintaining the established skill state. 2. Dual residual modules — Two asymmetric residual modules are then trained:
- A bounded residual stabilizer for task preservation.
- A context-aware residual that adaptively freezes the downstream policy only within the action subspace assigned to the new task.
Results
The framework was evaluated on 16 composite dexterous manipulation tasks, covering four object-holding skills and four downstream interactions. DexCompose achieves a 77.4% average composite success rate, indicating that structured action ownership combined with a dual-residual design provides a promising direction for dexterous skill composition beyond traditional policy chaining.
---
*Auto-collected on 2026-06-30*