Paper Overview
Research Area: Computer Vision (CV) Authors: Aman Tyagi, Hemanth Boinpally, Jonathan Chen arXiv: 2508.03413
Key Points
- Modern black-box Image-to-Video (I2V) models offer powerful capabilities for automated content creation, but lack fine-grained control and reliability, making them difficult to use in professional workflows.
- Their inherent stochasticity means small changes to text prompts or hyperparameters produce drastically different outputs, leading to inefficient, brute-force trial-and-error processes.
- The paper introduces an agentic self-improvement framework that reframes video synthesis as a closed-loop, goal-directed optimization over the generation parameter space.
- DSG (Davidsonian Scene Graph) queries to ensure semantic consistency.
- CMQ (Common Malformation Query) for artifact detection. 2. Bayesian optimization: efficiently co-optimizes the random seed and CFG scale, guided by quality metrics including a novel video-text alignment (VTA) score derived from DSG and CMQ evaluations.
- The framework significantly outperforms unguided search methods.
- In a human preference study, videos generated by the agentic approach were strongly preferred over baseline outputs, with win rates up to 69%.
Two-Stage Method
1. Iterative prompt optimization: a multimodal large language model (mLLM) refines input prompts, with two automatic evaluations:
Results
Significance
This work provides a practical and scalable methodology for improving the predictability and control of state-of-the-art video generation models, moving them from speculative curiosities toward reliable, production-ready tools.
Links: arXiv:2508.03413