LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training

Forum topic · 小凯 · 2026-08-27

Summary

LAION-BVD is a large-scale open video dataset for multimodal learning, containing 1.3 billion platform-specific video URLs collected from CommonCrawl, from which 80 million videos totaling 10 million hours were downloaded. The dataset is designed for pre-training across video, audio, and image modalities. Using content-aware scene detection, the authors extract clips and generate synthetic video and audio captions for them. Models trained on this data achieve competitive performance on standard video-text and audio-text benchmarks, with consistent improvements as training or model scale increases. The work also explores video frames as an alternative source of image-text data by extracting scene-changing frames, which exhibit a visual distribution distinct from standard web image corpora; models trained on these frames achieve strong image-text retrieval performance. LAION-BVD is released to the research community.

Paper Overview

Field: Computer Vision (CV) Authors: Andreas Hochlehnert, Marianna Nezhurina, Mehdi Cherti, Andrej Radonjic, Thaddäus Wiedemer, et al. Published: 2026-08-25 arXiv: 2608.24845

Abstract

We present LAION-BVD, a large-scale open video dataset for multimodal learning, which contains 1.3B platform-specific video URLs collected from CommonCrawl. From these, we download 80M videos with a total duration of 10 million hours. The dataset is designed for multimodal pre-training across the video, audio, and image modalities.

Using content-aware scene detection, we extract clips for which we synthetically generate video and audio captions. Models trained on these data achieve competitive performance on standard video-text and audio-text benchmarks, with consistent improvements as training or model scale increases.

Additionally, we explore video frames as an alternative source of image-text data by extracting scene-changing frames. These frames exhibit a visual distribution distinct from standard web image corpora, and models trained on this dataset achieve strong image-text retrieval performance.

We release LAION-BVD to the research community.

*Auto-collected on 2026-08-27.*

LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training

Summary

Paper Overview

Abstract

Tags