# GeoSemZip

Multi-view 3D vision-language models split a scene into 32 views and produce more than six thousand visual tokens, making inference expensive. GeoGR compresses at two levels: at the projector it consolidates cross-view observations into voxel tokens selected by semantic saliency and spatial coverage, merging unselected voxel features into contextual anchors; inside the LLM it computes visual tokens only within a middle-layer window, letting low-relevance tokens skip whole layers with hidden states preserved and rejoin at anchor layers. On LLaVA-OneVision-7B and Video-3D LLM-7B it retains 95.2% and 96.8% of the dense models' performance, with clear LLM prefill and time-to-first-token speedups.

Multi-view 3D vision-language models split a scene into 32 views and produce more than six thousand visual tokens, making inference expensive. GeoGR compresses at two levels: at the projector it consolidates cross-view observations into voxel tokens selected by semantic saliency and spatial coverage, merging unselected voxel features into contextual anchors; inside the LLM it computes visual tokens only within a middle-layer window, letting low-relevance tokens skip whole layers with hidden states preserved and rejoin at anchor layers. On LLaVA-OneVision-7B and Video-3D LLM-7B it retains 95.2% and 96.8% of the dense models' performance, with clear LLM prefill and time-to-first-token speedups.