RLSplat shrinks feed-forward 3DGS size, latency and memory linearly with the budget

Injae Kim, Minseok Joo, Jihwan Park, Sehyung Kim, Minseong Bae and Hyunwoo J. Kim present RLSplat, a resource-linear budget-controllable feed-forward 3D Gaussian Splatting framework. Prior methods first predict a dense set of Gaussians and then prune, so inference latency and peak memory stay nearly constant regardless of the requested budget.
RLSplat instead learns an allocation policy that distributes the budget across local scene regions and generates exactly the requested number of Gaussians, then refines them with resource-linear decoding in which each Gaussian attends only to nearby neighbors found by a hierarchical search. In zero-shot evaluation it outperforms prior budget-controllable methods at every budget, surpassing the strongest baseline even with 4× fewer Gaussians, and at low budgets runs up to 4.1× faster with 9.6× less peak memory.