Cornell's Pentimento uses Gaussian splats to document reclaimed timber builds

Researchers from Cornell Tech and the Royal Danish Academy’s CITA won the Best Paper Award at ACADIA’26 for Building Drift, which presents Pentimento, a tool that documents how a building made from reclaimed materials drifts away from its design. Builders record video and narration on a phone or smart glasses, and Pentimento estimates camera poses with COLMAP, trains a Gaussian splat and overlays it on the original 3D model, so every stakeholder can see where and why the build changed, as the Cornell Chronicle reports.
The team tested it on ReShelter, a reclaimed timber pavilion in a forest near Hvalsø, Denmark. According to Radiance Fields, ArUco markers register the splat to a glTF export of the CAD model, Whisper transcribes the narration, an AI model sorts each change into five drift categories, and the browser view renders splat and model together with three.js and Spark. The paper does not link to code.