Paper Overview
Field: Computer Vision (CV) Authors: Shravan Venkatraman, Omkar Thawakar, Ritesh Thawkar Published: 2026-08-11 arXiv: 2508.03807
Key Points
- Self-improvement for multimodal large language models (MLLMs) typically relies on reward-based methods that provide only coarse scalar feedback. Distillation offers richer dense token-level supervision, but in the visual domain it usually depends on privileged context built from external annotations, tools, or stronger models.
- The authors introduce CVPD (Contrastive Counterfactual Visual Process Distillation) — to the best of their knowledge, the first fully self-contained framework for dense, on-policy, token-level visual self-distillation for MLLMs.
- CVPD identifies visual blind spots: regions where zooming into a region changes and sharpens the model's answer distribution, while removing the same region leaves full-image behavior largely unchanged.
- These blind spots reveal perceptual information the model is capable of encoding but fails to consistently exploit under full-image conditions.
- A three-stage counterfactual criterion identifies such regions directly from the model's own responses and converts them into dense contrastive supervision for self-distillation.
- Outperforms 6 self-evolution baselines across 12 benchmarks, including methods that rely on external GPT-4o supervision, with no performance regressions.
- OCRBench: +3.60
- MMStar fine-grained perception: +3.38
- MMStar logical reasoning: +3.08
- Maintains or improves performance on broader multimodal benchmarks.
Results on Qwen3-VL-8B-Instruct
Original Abstract (excerpt)
> Self-improvement for multimodal large language models (MLLMs) is typically driven by reward-based methods that provide only coarse scalar feedback. Distillation offers a richer alternative through dense token-level supervision, but in the visual domain it usually depends on privileged context constructed using external annotations and tools, or stronger models. We introduce CVPD (Contrastive Counterfactual Visual Process Distillation), which, to the best of our knowledge, is the first fully self-contained framework for dense, on-policy, token-level visual self-distillation for MLLMs...
*Automatically collected on 2026-08-12*