CTBakeGS bakes a photorealistic CT volume rendering into 3DGS without training

Haruki Fukuda, Constantin Lux, Wolf Schweitzer, Tadashi Hosoya and Lars Ebert present CTBakeGS, which converts a photorealistic CT volume rendering directly into a 3D Gaussian Splatting model without per-scene training. Splats are placed on an adaptive octree of millimetre-sized cells; colour and opacity are computed on the GPU with the renderer’s lighting, cell opacity is converted analytically into splat opacity, and faint splats are retained stochastically above the 1/255 opacity floor of standard 3DGS rasterisers.
Six public CT scans with 1.5 mm voxels were converted with three transfer functions. Two-million-splat models reached a PSNR of 32.6 ± 0.9 dB for bone, 30.1 ± 1.0 dB for contrast-enhanced vessels and 32.3 ± 1.5 dB for skin and bone. A conversion pass took 4–30 seconds on a current laptop, where the models rendered at 68 frames per second at 800×800 pixels.