3D Gaussian Splatting Invades Game Engines: Phone Videos Become Walkable Scenes, 4DGS Makes Splats Move
> When "shoot a phone video and get a 3D scene you can walk into" becomes a button on a game-asset platform, splats have finally graduated from tech demo to boring infrastructure.
1. Engines Each Go Their Own Way, but Splats Are Already In Production
Khronos' KHR_gaussian_splatting extension is still stuck at release-candidate status and missed its Q2 2026 approval window (Q2 ended June 30; as of August 10 it still had not been formally approved). As a result, each engine has built its own incompatible format: Godot uses the community GDGS plugin (.ply with dual Compute/Rasterization rendering paths), Unity uses Aras's UnityGaussianSplatting (.ply), and Unreal Engine 5.7 relies on third-party plugins from Luma AI / Polycam. Only Cesium natively tracks the Khronos extension (for geospatial digital-twin scenarios). Community plugins realistically cap out at about 60 fps (under 1 million Gaussians) on hardware like an RTX 3060 / RX 6600.
2. World Labs + HTC VIVE: Turning AI-Generated Splats into Walkable UE Scenes
World Labs and HTC VIVE have introduced a workflow: the Marble world model generates 3D environments, which are imported into Unreal Engine 5.4-5.6 via the VIVE Mars Nova 3DGS plugin, outputting .ply/.spz. The key feature is configurable collision, letting characters and cameras "walk" into AI-generated geometry rather than treating it as a flat projection. Moonshine Studio XR tested it and generated 10+ environments in a single afternoon, with only a few hours from prompt to final-shot compositing — virtual production time costs are being dramatically reduced.
3. Volinga 4DGS and Tencent HY World: Making Splats Move and Capture a One-Button Job
- Volinga compresses motion-capture sequences (per-frame PLY) into a single NVOL asset that plays back in real time in Unreal, supporting UE 5.8 + DLSS + sublevel streaming + Sequencer. The shortcoming that static splats cannot be skeletal-animation-driven is being filled by 4DGS (the time dimension): performers, vehicles, and flowing water can all move in the shot.
- Scenario (a game-asset platform) integrated Tencent's HY World Multi-view to Splat on August 3: 2-64 overlapping photos or a single phone video → a Gaussian splat with up to 15 million points, no camera calibration and no COLMAP required. It runs three splat engines in parallel (World Labs Marble, HunyuanWorld, VAST TripoSplat), turning "scan the alley behind the office" from a photogrammetry project into a single phone recording.
- BitSoul, "Gaussian splatting missed glTF's Q2 deadline"
- IK3D, "Scenario + Tencent HY World: phone video to splat"
- TheNextGenTechInsider, "World Labs and HTC VIVE Enable Walkable 3D in Unreal"
- VP Land, "Volinga Adds 4D Gaussian Splatting to Unreal"
- Tencent News, "CaT-GS: CVPR 2026 uses game-engine caching to speed up 3DGS by 10×"
4. The Logic Worth Watching
Over the past two years splats have been busy proving they "look good"; now they are starting to prove they are "boring": able to exist as compliant, auditable infrastructure that sits in the same drawer as existing art pipelines. The real milestone isn't a model winning benchmarks — it's the model appearing as a button next to the tools you already use. The structural thorns remain: splats can't do skeletal animation, collision must be configured per object manually, and formats are not unified. CVPR 2026's CaT-GS (Shanghai Jiao Tong University + UIUC, arXiv:2607.17842) uses game-engine-style caching and speculative scheduling to speed up large-scene rendering by 10× — aimed squarely at getting splats into shipping builds.