Paper Overview
Research Area: Computer Vision Authors: Haodong Li, Shaoteng Liu, Tianyu Wang Published: 2026-08-11 arXiv: 2508.03804
Abstract (Translated)
The world evolves following its dynamics, i.e., its laws of motion. However, leading video diffusion models largely fit the pixels without modeling how the pixels transit over time. Thus, they render visually plausible frames but may not accurately obey the laws.
To capture the dynamics purely from pixels, the authors introduce Latent Dynamics Reasoning (LDR). LDR casts the latent transition as an explicit kinematic integration, where the lower-order dynamics are integrated numerically and the model regresses only the third- and higher-order residual that drives the rollout. For this integration to extrapolate better, LDR runs it on a structured latent rather than dense convolutional features.
Following PhyWorld, LDR is validated on a controlled white-box physics benchmark spanning five tasks (uniform motion, parabolic motion, collision, bouncing, approaching), focusing on out-of-distribution scenarios to reveal whether the model truly learns the underlying dynamics.
Key Results
- 20x smaller gap between in-distribution and out-of-distribution errors compared to video diffusion baselines, at both single-task and joint-task training with 256^2 resolution
- 26x fewer parameters and 143x faster inference than baselines
- Strong generalization: trained only on red balls moving left-to-right, LDR correctly predicts the motion of a blue square moving right-to-left under severe distribution shift
- Paper: arXiv:2508.03804
- Project page: https://lat-dyn-reason.github.io/
According to the authors, this is the first video world model to extrapolate learned dynamics beyond the training distribution.