VisibilitySplat adds a sparse ray-traced occlusion oracle to 3DGS inverse rendering

arXivarXivPapers

VisibilitySplat adds a sparse ray-traced occlusion oracle to 3DGS inverse rendering
arXiv / Sven Kluge and Oliver Staadt

Sven Kluge and Oliver Staadt present VisibilitySplat, which augments rasterized 3D Gaussian Splatting with a sparse visibility oracle for relighting and for material and light decomposition. The oracle is a point-based ray tracer accelerated by a bounding volume hierarchy, queried sparsely from sampled lighting directions, while the original 3DGS loop is kept for training, visualization and tooling. Shading uses a microfacet BRDF and low-resolution HDR environment maps.

On the TensoIR synthetic dataset, the authors report competitive novel-view synthesis, albedo reconstruction and relighting against NeRF, tensor and 3DGS baselines, and say ablations show that explicit visibility modeling helps relighting and material-illumination disentanglement. The work is published at WSCG 2026.