An exploratory study turns in-the-wild video into a Gaussian splat digital twin

arXivarXivPapers

An exploratory study turns in-the-wild video into a Gaussian splat digital twin
arXiv / Mohapatra

Somesh Mohapatra reports an exploratory study of generative world models and 3D Gaussian Splatting on an uncurated news walkthrough of a food bank warehouse, with no scans or site visit. A commercial world model given 20 frames recovered camera poses and metric depth for three areas, which were fused into about 747,000 Gaussian splats; locally optimized splat models looked photorealistic near the filmed path but degraded quickly away from it.

On held-out frames, scored only in pixels not covered by people, those local models reached 21.2 and 23.1 dB PSNR from 64 and 43 training frames. Attempts to generate views of unseen areas failed on the provider’s side twice, and the author describes the corrections needed to turn the output into a metric OpenUSD asset with its native splat schema. The work is presented as an exploration, not a deployed product.