AEON generates 4D Gaussian worlds from video-model latents

arXivarXivPapers

AEON generates 4D Gaussian worlds from video-model latents
arXiv / Weiqi Zhang, Wenyuan Zhang and colleagues

Weiqi Zhang, Wenyuan Zhang, Yu-Shen Liu and Junsheng Zhou present AEON, a unified world model accepted at NeurIPS 2026 that operates in a text- or image-conditioned video latent space while producing renderable 4D Gaussian Splatting primitives as the explicit world representation. A 4D reconstruction model is trained to predict both 4DGS and camera poses from monocular videos, and a domain adapter translates generative video latents into reconstructive 4D latents through distillation on the video VAE.

AEON can render 4DGS along predicted camera trajectories and also construct a persistent 4D environment with scene dynamics. The authors report state-of-the-art performance on standard benchmarks and a range of world-modeling applications.