Paper Overview
Field: Computer Vision (CV) Authors: Yizhou Xu, Lars Bretzner, Tiesheng Wang, Atsuto Maki Release Date: 2026-08-11 arXiv: 2608.11203
Abstract
This paper presents a self-supervised representation learning framework for understanding 3D skeleton-based human motion in soccer, using future motion prediction as the learning objective. Since human motion is inherently uncertain, accounting for multiple plausible futures is essential for capturing the underlying motion dynamics and learning effective representations. To this end, we introduce a conditioning module for motion prediction that models a probabilistic distribution over discretized future motions in 3D Euclidean space, learning multimodality with explicit supervision from future trajectories. Experiments on large-scale soccer player tracking data show that our approach substantially improves motion prediction accuracy. Moreover, the learned representations effectively transfer to multiple downstream soccer applications, demonstrating strong cross-task generalization ability.
Key Points
- Problem: Capturing the inherent uncertainty in 3D skeleton-based human motion for soccer analytics, where multiple plausible future trajectories exist for the same past motion.
- Method: A self-supervised framework built around future motion prediction as the pretext task.
- Core Component: A conditioning module that models a probabilistic distribution over discretized future motions in 3D Euclidean space.
- Multimodality Learning: Multimodal futures are learned through explicit supervision from ground-truth future trajectories, rather than only via latent sampling.
- Data Scale: Evaluated on large-scale soccer player tracking data.
- Results: Substantial improvements in motion prediction accuracy over baselines.
- Transferability: Learned representations generalize effectively to multiple downstream soccer tasks, indicating useful task-agnostic motion features.
- Relevance: Useful for sports analytics, tactical modeling, and broader human motion understanding where uncertainty is critical.