Gaussian splats skip the rasterizer: GaussianRenderFormer renders directly, reaching 38.08 dB on unseen objects
GaussianRenderFormer replaces the hand-written rasterizer in 3D Gaussian splatting with a transformer: one token per Gaussian, and a view-dependent decoder that turns small patches of camera rays into pixels. Trained on 26,820 Objaverse objects, it reaches 38.08 dB PSNR on 300 unseen objects against renders of the full splat, while rasterizing the same pruned input reaches 44.02 dB; diagnostics point to a view-decoder bottleneck, though under-training is not ruled out.