OctreeSplat allocates feed-forward Gaussians according to local scene complexity

Yibin Zhao, Yihan Pan, Wenli Yang, Jun Nan and Jianjun Yi present OctreeSplat, a hierarchical octree-guided feed-forward Gaussian splatting method. Feed-forward 3DGS often uses a fixed image or spatial resolution, which limits the ability to allocate primitives according to local complexity; OctreeSplat extracts multi-view features and geometric priors from a frozen visual foundation model, constructs a hierarchical octree, and predicts densification scores so Gaussians are placed at spatially varying densities.
Stochastic solids volume rendering is used to improve depth rendering and support surface reconstruction, and an optional test-time optimization module can improve agreement between predicted and ground-truth camera parameters. Training updates only 76 million additional parameters and requires 35 GPU-hours. The authors report competitive RGB view synthesis, depth synthesis and surface reconstruction on Replica, TUM, Tanks and Temples, and DTU.