ClusterSplat selects scene-adaptive Gaussian clusters for 3D visual grounding

arXivarXivPapers

ClusterSplat selects scene-adaptive Gaussian clusters for 3D visual grounding
arXiv / Jaesung Lee, Hyeontaek Hwang and colleagues

Jaesung Lee, Hyeontaek Hwang, Gabriel Manalu and Daeyoung Kim present ClusterSplat, a NeurIPS 2026 Spotlight paper on 3D visual grounding in 3D Gaussian Splatting, where a referring expression should identify a target both as a rendered 2D mask and as a set of explicit 3D Gaussians. Instead of heuristic thresholding of dense primitive-level scores, the method learns instance-aware Gaussian features, forms feature-aware seed voxels, and merges neighboring seeds when a description-length criterion decreases, producing scene-specific cluster candidates.

A query-conditioned scorer ranks those clusters, and the selected cluster defines the explicit 3D target while its score is rendered for the 2D mask. On ScanRefer, ClusterSplat achieves the best rendered 2D segmentation and explicit 3D target metrics among the compared 3DGS baselines.