DUET4D lets a 4DGS reconstruction and a generative prior correct each other

arXivarXivPapers

DUET4D lets a 4DGS reconstruction and a generative prior correct each other
arXiv / Beizhen Zhao, Nanjie Yao and colleagues

Beizhen Zhao, Nanjie Yao, Boyi Fu, Qingsong Yan, Haofan Ren, Kaiyong Zhao and Hao Wang present DUET4D, a self-corrective coupled-guidance framework for sparse-view 4D Gaussian splatting. They argue that video generative priors are too expensive for iterative reconstruction and that single-view models produce temporally inconsistent pseudo-observations, while absorbing uncertain generative outputs into Gaussian optimization creates redundant primitives and floaters.

DUET4D first builds sequential alignments from current Gaussian evidence to steer latent restoration, then uses Sequential Fidelity Resampling to lift generative supervisions into Gaussian space and keep repeatedly supported primitives. The corrected representation then provides more reliable evidence for the next cycle. The authors report significant improvements in rendering quality and efficiency.