Summary
Syn4D is a multiview synthetic dataset of dynamic scenes designed to advance dense 3D reconstruction and tracking from monocular video, a longstanding open challenge in computer vision. Progress in this field has been limited by the scarcity of high-quality datasets with dense, complete, and accurate geometric annotations. Syn4D provides ground-truth camera motion, depth maps, dense tracking, and parametric human pose annotations, with a distinctive capability: any pixel can be unprojected into 3D space at any time and from any camera viewpoint. The authors evaluated the dataset across multiple downstream tasks, including 4D scene reconstruction, 3D point tracking, geometry-aware camera retargeting, and human pose estimation. The experiments demonstrate Syn4D's utility and highlight its potential to support research in dynamic scene understanding and spatiotemporal modeling. The paper is authored by researchers including Zeren Jiang, Christian Rupprecht, Diane Larlus, and Andrea Vedaldi, and is available on arXiv.
Syn4D: A Multiview Synthetic 4D Dataset
Research area: Computer Vision
Authors: Zeren Jiang, Yushi Lan, Yihang Luo, Yufan Deng, Zihang Lai, Edgar Sucar, Christian Rupprecht, Iro Laina, Diane Larlus, Chuanxia Zheng, Andrea Vedaldi
arXiv: 2605.05207
Abstract
Dense 3D reconstruction and tracking of dynamic scenes from monocular video remains an important open challenge in computer vision. Progress in this area has been constrained by the scarcity of high-quality datasets with dense, complete, and accurate geometric annotations. To address this limitation, the authors introduce Syn4D, a multiview synthetic dataset of dynamic scenes that includes ground-truth camera motion, depth maps, dense tracking, and parametric human pose annotations.
A key feature of Syn4D is the ability to unproject any pixel into 3D at any time and from any camera viewpoint. The authors conduct extensive evaluations across multiple downstream tasks to demonstrate the utility and effectiveness of the proposed dataset, including:
- 4D scene reconstruction
- 3D point tracking
- Geometry-aware camera retargeting
- Human pose estimation
The experimental results highlight Syn4D's potential to facilitate research in dynamic scene understanding and spatiotemporal modeling.
---
*Auto-collected on 2026-05-08.*
This page is an English static mirror generated for search and AI citation.
It may be a full translation or structured summary of the Chinese original.
Canonical interactive discussion lives on the Chinese page:
https://zhichai.net/topic/177619578