RecallGS retrieves geometric-semantic context from an agent's past views, without a learned 3D branch

Thanh-Khoi Nguyen, Thien-Phuc Tran and Minh-Triet Tran present RecallGS, a training-free mechanism for online semantic 3D Gaussian Splatting. Existing methods recover geometric context missing from image-derived semantic features with an additionally learned 3D network; RecallGS instead treats past observations as a non-parametric prior.
The pipeline retrieves relevant observations with CLIP, uses alpha-compositing weights to identify geometrically supported views, and aggregates their semantic features over each Gaussian’s rendered footprint. On ScanNet and ScanNet++, RecallGS achieves strong semantic segmentation performance at 2.48 frames per second.