[论文] SCULPT: Subtractive Composition for 3D Part Generation

论文概要

研究领域: CV
作者: Sikuang Li, Chen Yang, Jiemin Fang, Jiazhong Cen, Yuhe Wei, Jichen Pang, Wei Shen, Qi Tian
发布时间: 2026-08-13
arXiv: 2608.13541

中文摘要

部件感知3D生成旨在创建作为完整对象一致的数字资产，同时暴露结构部件以供编辑、材质分配、动画和重用。现有方法在原生生成循环外部施加这种结构：基于分割的方法划分已生成的形状，而加法方法从预定义布局、框或token合成部件然后将其调和为整体。前者保留生成的几何但固定对象在部件边界确定之前；后者暴露部件基数但经常使共享边界易受间隙、互穿和材质不连续的影响。本文提出SCULPT，一种通过减法式组合解决这些挑战的框架。给定在结构化3D潜空间中表示的完整对象，SCULPT迭代应用联合分割预测器生成一个提取的部件和剩余对象。预测器执行以图像和当前3D状态为条件的耦合去噪过程，因此提取的部件和更新的余量一起生成而非在生成后调和。联合分割预测器在其原生稀疏3D支持的并集上处理两个输出，允许相邻支持重叠而非施加不相交的体素分割。当余量支持变为空或达到固定安全上限时推出结束，允许生成的部件数量在该界限内适应每个对象。大量实验在PartObjaverse上展示了最先进的几何性能，同时在部件组装后保持强大的完整对象重建。在四个数据集图像、一个文本到图像生成输入和一个真实世界照片上的结果进一步展示了超越基准的细粒度纹理部件分解。

原文摘要

Part-aware 3D generation aims to create digital assets that are coherent as complete objects while exposing structural parts for editing, material assignment, animation, and reuse. Existing methods impose this structure outside the native generation loop: segmentation-based methods partition an already generated shape, while additive methods synthesize parts from predefined layouts, boxes, or tokens and then reconcile them into a whole. The former preserves the generated geometry but fixes the object before part boundaries are determined; the latter exposes part cardinality but often leaves shared boundaries vulnerable to gaps, interpenetrations, and material discontinuities. In this paper, we propose SCULPT, a framework that addresses these challenges through subtractive composition. Given a complete object represented in a structured 3D latent space, SCULPT iteratively applies a joint split predictor to generate one extracted part together with the remaining object. The predictor performs a coupled denoising process conditioned on both the image and the current 3D state, so the extracted part and updated remainder are generated together rather than reconciled after generation. The joint split predictor processes both outputs on the union of their native sparse 3D supports, allowing neighboring supports to overlap rather than imposing a disjoint voxel partition. The rollout ends when the remainder support becomes empty or reaches a fixed safety cap, allowing the number of generated parts to adapt to each object within that bound. Extensive experiments demonstrate state-of-the-art geometry on PartObjaverse while preserving strong complete-object reconstruction after part assembly. Results on four dataset images, one text-to-image-generated input, and one real-world photograph further show fine-grained textured part decomposition beyond the benchmark.

自动采集于 2026-08-15

#论文 #arXiv #CV #小凯