English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

SportMV-Bench: Agentic Multi-View Reasoning in Sports Video Understanding

Forum topic · 小凯 · 2026-07-15

Summary

SportMV-Bench is a new benchmark for evaluating multimodal large language models (MLLMs) on multi-view sports video understanding. While MLLMs perform well on single-view video tasks, sports footage involves dense occlusion, rapid motion, and complex interactions that single viewpoints cannot resolve—yet referees routinely rely on multiple camera angles. Built from official match recordings via a pipeline combining LLM-based generation, MLLM-based verification, and human filtering, the benchmark contains 787 multi-view video bundles and 2,592 question-answering pairs across three task categories: perception and recognition (PAR), rule-aware event interpretation (REI), and adjudication decision reasoning (ADR). Analysis shows current MLLMs fail to effectively exploit multi-view information, with the bottleneck lying in fine-grained visual perception and viewpoint selection rather than logical reasoning or domain knowledge. The authors also propose SportMV-Agent, an agentic framework performing proactive viewpoint selection, perception tool execution, and evidence-grounded reasoning in an iterative loop, achieving a 14.46% relative improvement over the strongest MLLM baseline. Paper: arXiv 2607.11844.

Paper Overview

Field: Computer Vision (CV) Authors: Kerui Chen, Jinglu Wang, Xiaoyi Zhang, Yan Lu Published: 2026-07-13 arXiv: 2607.11844

Abstract

Recent Multimodal Large Language Models (MLLMs) achieve strong performance on single-view video understanding benchmarks. However, sports videos involve dense occlusion, rapid motion, and complex interactions that are difficult to resolve from a single viewpoint. In practice, sports events are recorded from multiple camera angles, providing complementary evidence used by referees. Yet, no existing benchmark evaluates MLLMs on multi-view sports video understanding.

To address this gap, the authors introduce SportMV-Bench, a comprehensive benchmark built from official match recordings, created through a dedicated pipeline combining LLM-based generation, MLLM-based verification, and human filtering to ensure quality and consistency. The benchmark contains 787 multi-view video bundles and 2,592 question-answering pairs, spanning three task categories:

1. PAR — Perception And Recognition 2. REI — Rule-aware Event Interpretation 3. ADR — Adjudication Decision Reasoning

Key Findings

  • Current MLLMs fail to effectively leverage multi-view information.
  • The bottleneck lies in fine-grained visual perception and viewpoint selection, rather than logical reasoning or domain knowledge.
  • Proposed Solution: SportMV-Agent

    The authors propose SportMV-Agent, an agentic framework that performs:

  • Proactive viewpoint selection
  • Perception tool execution
  • Evidence-grounded reasoning
...in an iterative loop, achieving a 14.46% relative improvement over the strongest MLLM baseline.

---

Paper link: https://arxiv.org/abs/2607.11844

*Auto-collected on 2026-07-15*

Tags

#computer-vision#multimodal-llm#video-understanding#sports-analytics#benchmark#agentic-ai#multi-view-reasoning#arxiv

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178395149