GOFish trains 3DGS on fisheye images, rasterizes past 180° and extracts an aligned mesh

arXivarXivPapers

GOFish trains 3DGS on fisheye images, rasterizes past 180° and extracts an aligned mesh
arXiv / Allen Tu, Meher Gitika Karumuri and colleagues

Allen Tu, Meher Gitika Karumuri, Shifan Zhu and colleagues present GOFish, which they describe as the first 3D Gaussian Splatting surface-reconstruction method to train directly on fisheye images, rasterize fields of view beyond 180°, and extract an aligned mesh from the same scene. Calibrated densification recovers the surface across the entire field of view, while Calibrated Mip Filtering and Wide-Angle Appearance Modeling keep pixel blur and lens falloff out of the scene and mesh.

Across the 200° FIORD and 205° FullCircle benchmarks, GOFish improves PSNR over the best prior method by 2.28 and 1.97 dB, respectively, and achieves the highest mesh F-score on FIORD and the main ScanNet++ set. The Gaussian scene and mesh together form a LiDAR-free, simulation-ready digital twin.