GradSplat refines feed-forward Gaussian shapes with gradient steps inside the forward pass

arXivarXivPapers

GradSplat refines feed-forward Gaussian shapes with gradient steps inside the forward pass
arXiv / Jingong Chen, Linlian Jiang and colleagues

Jingong Chen, Linlian Jiang, Guangyuan Li and colleagues present GradSplat, a feed-forward 3D Gaussian Splatting model that refines its own Gaussians by learned gradient steps inside the forward pass, with no target view. They argue that the gap between a feed-forward predictor and per-scene optimized Gaussians lies mostly in scale and rotation, and that gradient steps on the input views can correct that shape.

Log-anisotropy correction changes the axis ratios of each Gaussian in log space at constant volume, and in-forward gradient refinement renders the Gaussians into the input views and applies the photometric-loss gradient with a learned recurrent update, first to opacity and color and then to shape. On both complete six-view RealEstate10K protocols it has the best PSNR and SSIM among nine methods, and without fine-tuning it is the most accurate on DL3DV.