SpatialView indexes Gaussian splat scenes so AI agents can query them in language

Radiance Fields reports new work from Vancouver-based SpatialView on using radiance-field captures as a data source for AI agents. Rather than depending on the original survey photographs, the pipeline renders a compact set of virtual views from the finished Gaussian splat, embeds each view with an image-text model, and stores it with its camera position as a “scene matrix.”
A query such as “where is the fire extinguisher?” returns the best-matching rendered views and their locations in the 3D model. On a 1.8-million-Gaussian cabin scan with source photos withheld, SpatialView reports that 122 virtual photographs were enough to index the scene, compared with 362 photos in the original capture, with framing and embedding taking under two minutes. The write-up includes a browser demo of that cabin.
«Ask the Scene» Comic