X-Splat reconstructs RGB and X-ray together with one shared Gaussian geometry

arXivarXivPapers

X-Splat reconstructs RGB and X-ray together with one shared Gaussian geometry
arXiv / Wangze Xu, Chu Zhou and colleagues

Wangze Xu, Chu Zhou, Mae Yamaguchi, Linrui Dai, I-Chao Shen, Takashi Ijiri and Imari Sato present X-Splat, a unified Gaussian splatting representation for joint RGB and X-ray 3D reconstruction, accepted as a SIGGRAPH Asia 2026 Conference Paper. All Gaussian primitives share a single set of geometric parameters, and only surface-proximal primitives also carry appearance attributes. Cross-modal registration uses multi-view stereo and X-ray geometric proxies rather than aligning two independently optimized Gaussian sets.

Joint optimization is supervised by both modalities, with a surface-depth consistency loss from X-ray geometry guiding the RGB reconstruction. On the InsideOut dataset and a Flower & Insect dataset, the authors report more robust alignment, higher RGB rendering quality without compromising X-ray reconstruction, and a more compact representation than two independent geometries.