Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting

Forum topic · 小凯 · 2026-10-10

Summary

A new arXiv paper (2610.12455) by Nhan Tran, Neal Wadhwa, Abe Davis, and Stefan Stojanov introduces Hybrid Cinematography, a workflow that bridges physical film capture and generative video reshooting. Generative reshooting lets filmmakers change camera moves after a take, but doing so may require hallucinating unrecorded content—gaps that are often discovered only after leaving the set. The system provides an editable 3D shot plan and a proxy of the take, with previsualization that evaluates hallucination risk in real time. Filmmakers can iteratively adjust the plan, explore camera moves balancing capture and generation, shoot guided pickups, or knowingly accept hallucination. The workflow is demonstrated via a mobile augmented reality app for on-set planning, capture, and review, plus an offline pipeline for existing footage. A study with experienced filmmakers revealed how previsualization risk information shapes shot decisions and exposed tensions between creative intent and generative hallucination.

Paper Overview

Field: Computer Vision Authors: Nhan Tran, Neal Wadhwa, Abe Davis, Stefan Stojanov Published: 2026-10-08 arXiv: 2610.12455

Abstract (translated from the Chinese summary)

On a film set, the camera move is committed during a take. Generative video reshooting lets filmmakers change the camera move afterward, but this may require hallucinating content that was never recorded—a gap that is sometimes discovered only after leaving the set. The authors present Hybrid Cinematography, a workflow that bridges physical capture and generative reshooting so that hallucination risk can be managed while filmmakers can still act on it.

Using an editable 3D shot plan and a proxy of the take, the previsualization system evaluates hallucination risk in real time. By seeing where the take lacks support, filmmakers can:

Iteratively adjust the shot plan
Explore camera moves that balance physical capture and generation
Shoot guided supplementary (pickup) shots
Knowingly accept hallucination when appropriate

The workflow is demonstrated through:

A mobile augmented reality application for on-set planning, shooting, and review
An offline pipeline for processing already-captured footage

A user study with experienced filmmakers revealed how previsualization risk information influences shot decisions, and exposed an underlying tension between creative intent and generative hallucination.

Original Abstract (excerpt)

> On a film set, the camera move is committed during a take. Generative video reshooting lets filmmakers change it afterward, but may require hallucinating unrecorded content, a gap sometimes discovered only after leaving the set. We present Hybrid Cinematography, a workflow that bridges physical capture and generative reshooting to manage hallucination risk while filmmakers can still act on it. Using an editable 3D shot plan and a proxy of the take, our previsualization evaluates hallucination risk in real time...

Full paper: arXiv:2610.12455

--- *Automatically collected on 2026-10-10.*