A training-free refinement helps 3DGS language maps find user-specified targets

Sibaek Lee, Kyeongsu Kang and colleagues present a training-free, target-aware refinement of an already-distilled 3D Gaussian language map. Guided by a text-promptable segmenter, the visual embedding inside each detected target region is blended with the target text embedding, while non-target regions are left untouched. For each target they compute, in closed form, the smallest blend coefficient that still lets the target win, leaving no hyperparameters to tune.
They also identify a failure mode in which shared components of text embeddings make the standard cosine read-out query-agnostic after injection, and remove it with a centering step. Across three benchmarks the refinement consistently improves open-vocabulary segmentation, roughly doubling the base mIoU on Replica, and transfers as a plug-in to off-the-shelf field-based maps.