English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

MiniMax-H3 Deep Dive: The 33B Omni-Modal Video Generation Model

Forum topic · ✨步子哥 · 2026-08-12

Summary

MiniMax-H3 (Hailuo 3.0) is a 33B-parameter dense, single-stream transformer for omni-modal video generation that jointly produces video and native 32kHz stereo audio in a single forward pass, rather than stitching sound onto silent footage afterward. Released via API and the Hailuo app on 2026-07-31 with open weights on Hugging Face (MiniMaxAI/MiniMax-H3) on 2026-08-03, it outputs up to 15s at 24fps, 768p locally (2K via cloud-only H3-Regenerate-2K), accepting mixed inputs of up to 9 images, 3 videos, and 3 audio clips. Key corrections circulated by the community: H3 is not a Mamba/SSM hybrid but a dense transformer unified by 3D multimodal RoPE; full stack is ~144GB BF16, with a quantized ComfyUI build at ~42.5GB. It is not OSI open source: a custom Community License excludes the US, EU, UK, and Korea, caps free commercial use at $20M annual revenue, bans distillation, and requires visible branding—though MiniMax has stated intent to migrate to Apache 2.0 pending copyright litigation resolution. It ranks #1 among open video models on Video Arena and leads Artificial Analysis audio-video editing (~1130 Elo), positioned against Sora 2, Veo 3.1, and Seedance at roughly one-third the price.

MiniMax-H3 Deep Dive: The 33B Omni-Modal Model That Generates Video and Sound Together

*Cross-verified from official blog, HF model card, AMA, and independent media (August 2026). Subject: MiniMaxAI/MiniMax-H3 (aka Hailuo 3.0).*

Key points

  • One model, joint generation: H3 is a 33B dense, single-stream transformer that generates video with native stereo audio (dialogue, SFX, music) in one forward pass — not a silent-video model with post-hoc dubbing.
  • Released 2026-07-31 (API + Hailuo app, same day as ByteDance Seedance 2.5); open weights on Hugging Face 2026-08-03.
  • Output: up to 15s, 24fps, 2K (cloud only); default open H3-Base outputs 768p. Audio: native 32kHz stereo.
  • Inputs: mixed modalities up to 9 images + 3 videos + 3 audio clips; 7,000-character prompt limit; 11 languages.
  • Fact corrections (important)

  • Architecture: H3 is a dense single-stream transformer unified by 3D multimodal RoPE, not a Mamba/SSM hybrid (a confusion with MiniMax-01's lightning attention). No Mamba blocks.
  • No local 2K: H3-Regenerate-2K is not open-sourced; local output is 768p only.
  • Memory: the "33B" refers to the DiT body; the full stack is ~144GB BF16 (DiT 66.3 + encoders 66.7 + video VAE 10.4 + audio VAE 0.6). Quantized ComfyUI build: ~42.5GB. RTX 3060 12GB works only with heavy quantization/offloading (~5 min for 5s 480p). Apple Silicon: ≥192GB unified memory recommended (512GB verified).
  • Not fully open: Community License (not OSI); H3-Context-IR (instruction-based editing) and H3-Regenerate-2K are closed. The only true Apache 2.0 component is the Qwen3-VL-32B text encoder.
  • Architecture

  • H3-Omni-Transformer: 50 layers, hidden dim 5376, no modality-specific attention/FFN; ~13B params live in AdaLN branches whose outputs can be precomputed and cached, cutting inference memory substantially (MLX port: ~134GB → ~40GB).
  • H3-VisualVAE (f16t4d24): 16× spatial, 4× temporal compression, then 1×2×2 patchify (effective 32× spatial downsample).
  • H3-AudioVAE: processes left/right channels separately at 32kHz → 40Hz latent tokens, recombined into stereo.
  • A sparse-attention path was mentioned by MiniMax but the open runtime is full-attention only — don't compare local latency directly to cloud.
  • Capabilities and benchmarks

  • Native stereo audio is the key differentiator among open models (HunyuanVideo 1.5 is silent).
  • Ref2VA multi-reference mode: up to 9 images + 3 videos + 3 audios fused per natural-language instructions — the standout feature.
  • Video Arena: #1 open video model (1476 I2V Elo, 2 points behind Seedance 2.0, ~280 above HunyuanVideo-1.5). Artificial Analysis: #1 audio-video editing (~1130 Elo). Caveat: Arena Elo is directional, not ground truth.
  • Known weakness: audio quality depends heavily on explicit sound descriptions in prompts; underspecified prompts yield "speech-shaped noise."
  • License (read carefully)

  • Effective 2026-08-02, governed by Hong Kong law. Territorial exclusion: US, EU, UK, Korea require separate authorization (per MiniMax's Ryan Lee, tied to ongoing Hollywood copyright litigation with Disney/Universal/Warner). Annual revenue >$20M requires prior written approval. Commercial UIs must prominently display "MiniMax H3". Distillation into other models is prohibited. On 2026-08-09 MiniMax announced intent to migrate to Apache 2.0 once copyright issues resolve, and to open H3-Regenerate-2K, 4/8-NFE low-step variants, and a T2I model.
  • Ecosystem and deployment

  • Day-0 support: ComfyUI (Comfy-Org/MiniMax-H3 workflows + quantized weights), Diffusers pipelines, SGLang, h3.c (antirez's MIT-licensed C/Metal port), plus 16 chip platforms (NVIDIA, Intel, AMD, Huawei Ascend, MetaX, Moore Threads, Apple).
  • Hardware tiers: 24GB cards with quantization → good quality; 12GB + offload → 1–5 min per 5s 480p clip; DGX Spark FP8 (~89GB loaded, ~155s FL2VA); 8×141GB servers for full BF16.
  • Local runs are 768p; 2K requires the cloud API (~¥0.8/s on some MaaS providers), roughly one-third the price of Sora 2 / Veo 3.1 / Seedance.

Competitive position

| Model | Local? | Native audio | Open weights | |---|---|---|---| | MiniMax H3 | Yes (quantized, 768p) | Yes (stereo 32k) | Yes (Community License) | | Sora 2 / Veo 3.1 | No | Yes | No | | Seedance 2.0/2.5 | No | Yes | No | | HunyuanVideo 1.5 | Yes | No | Yes | | Wan 2.7 / LTX-2.3 | Yes | Yes | Yes |

H3's edge is the combination: open weights + local control + native audio + multi-reference control + ~1/3 the price.

Honest limitations

1. "Open" ≠ OSI open source: license exclusions, revenue cap, two closed modules. 2. Local is 768p only; 2K is cloud-exclusive. 3. Audio requires deliberate prompt engineering. 4. Hardware requirements are softened by marketing (full stack ~144GB). 5. Benchmarks are directional; sparse-attention cloud path not comparable to local.

Conclusion

MiniMax-H3 productizes the hardest problem in generative video — audio-visual co-generation — as a 33B dense single-stream transformer with unmatched multi-reference control among open models. It cracks open a field previously held by Sora/Veo, part of the 2026 wave of open-weight releases from Chinese labs (alongside DeepSeek, Qwen, Kimi). For local-first, data-sovereign workflows it is arguably the top open-weight video candidate — but expect 768p locally, prompt-dependent audio, real hardware requirements, and a restrictive (possibly temporary) license, not a free lunch.

Tags

#minimax-h3#video-generation#omni-modal#open-weights#hailuo#audio-video-generation#comfyui#license

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178633386