LENS runs localization and Gaussian splat rendering on an AMD KR260 FPGA

arXivarXivPapers

LENS runs localization and Gaussian splat rendering on an AMD KR260 FPGA
arXiv / Haohua Que, Mingkai Liu and colleagues

Haohua Que, Mingkai Liu, Tianle Zhu and Handong Yao present LENS, an edge scene-memory system that brings an ACEsplat-style workload of scene-coordinate regression and 3D Gaussian splat rendering to a low-power AMD KR260 FPGA and ARM platform. An INT16 SCR accelerator preserves pose accuracy, and a bit-exact fixed-point ordered 3DGS renderer rewrites alpha transmittance as a log-sum-exp recurrence and drops provably useless streamed Gaussians.

All reported figures are board-measured. The SCR engine preserves DSAC* localization accuracy at 25.42 ms, the on-board renderer reaches 34.11 dB on Cambridge against ACEsplat’s 33.20, and novel-view synthesis on RealEstate10K reaches 27.84 dB against 26.11. LENS wins performance per watt over a Jetson Orin NX on every deployment task, by 1.9× to 5.7× at about a quarter of the power.

«On an FPGA» Comic