Skip to main content
Search

# Novel View Synthesis

12 related articles

Subscribe to updates
  1. World Labs

    Atlas world model goes real-time: Frameboy streams cloud-GPU frames to the browser at up to 15 fps

    Atlas is an autoregressive world model that previously took tens of seconds to minutes to produce a generated video, so users planned camera paths cautiously. The newly released Frameboy research preview serves a highly optimized Atlas variant from cloud GPUs and streams frames to the browser at up to 15 fps, updating the view continuously as the camera moves. The demo can generate scenes from a single image or text caption and retains and improves novel view synthesis from multiple images, but it must run on a powerful cloud GPU server and costs more than local rendering.

  2. World Labs

    Atlas world model goes real-time: Frameboy streams camera-driven frames to the browser at up to 15 fps

    Atlas was an autoregressive world model that generated frames one at a time, and users waited tens of seconds or even minutes for a video, so they planned camera paths cautiously. The new research preview Frameboy serves a highly optimized Atlas variant from cloud GPUs, streaming frames to the browser at up to 15 fps so the view updates continuously as the camera moves. The same real-time capability is integrated into the web app Viewfinder, where users build their own scenes frame by frame and then explore them live through a Frameboy overlay.

  3. arXiv

    Dynamic world models stop re-rendering every request: a 4D latent cache cuts conditioning from 14.9% to 0.25% of generation time

    In dynamic world modeling, the same observations must condition repeated generation at different times and viewpoints, and prior pipelines rendered the reconstructed scene to RGB and re-encoded it for every request. 4LC binds visual representations of static and dynamic content from several encoders to shared geometry and motion, forming a 4D latent cache that is read directly at independently specified times and viewpoints. Under identical generation settings, conditioning falls from 14.9% to 0.25% of end-to-end generation time, and a single 4LC-Video model covers camera control, temporal control, novel-view synthesis, scene revisits and long-term generation without task-specific fine-tuning.

  4. arXiv

    World models stop guessing whole frames: learn an uncertainty map, let diffusion fill only what it must

    D3WM splits next-frame prediction into a deterministic part and an uncertain part, using a learned uncertainty map to steer a diffusion model toward occlusions and dynamic textures, and it beats comparison world models on both robotic manipulation and camera motion.

  5. arXiv

    OX-NeRF attains the highest 3D reconstruction accuracy on ultra-sparse X-ray scenes with four to ten projections

    The authors present OX-NeRF, which fuses a cross-scene convolutional encoder with a per-scene multi-resolution hash grid into an MLP and optimises them jointly by self-supervision, achieving higher 3D reconstruction accuracy than existing self-supervised radiance field methods on parallel-beam and cone-beam X-ray datasets in the ultra-sparse regime of four to ten projections.

  6. arXiv

    RDGSplat decodes render-dedicated geometry on a frozen 3D foundation model, lifting WM2.0 on RE10K from 20.918 to 24.266 dB while leaving its metric predictions unchanged

    RDGSplat introduces a two-pass framework that decodes a render-dedicated geometry from a frozen 3D foundation model by duplicating pretrained decoders and optimizing them under photometric supervision alone, together with a target-pose conditioned adapter that reformulates the representation those decoders read, while the model's metric predictions remain unchanged. Across four benchmarks and three feed-forward backbones, it improves novel view synthesis, raising WM2.0 on RE10K from 20.918 to 24.266 dB with 205.5 M added trainable parameters, and the depth and pose the same model predicts are bit-exact.

  7. arXiv

    MoonGS reconstructs lunar terrain from image pairs with a frozen vision foundation model and semantic ranking loss, reaching 23.80 dB PSNR on LuSNAR

    MoonGS is a feed-forward 3D Gaussian Splatting framework for lunar scenes: given only two images it predicts pixel-aligned Gaussian primitives in a single forward pass with no per-scene optimization, using robust depth features from a frozen vision foundation model (DUSt3R, or VGGT), semantic priors plus a semantic ranking loss to regularize weakly textured background depth, and an entropy-guided heuristic resampling strategy to augment sparse observations. On the LuSNAR benchmark and the authors' weak-texture MoonBlender dataset it outperforms feed-forward NeRF/3DGS baselines on PSNR, SSIM and LPIPS while keeping sub-second inference.

  8. arXiv

    SNAP constrains the decoder and predicts latent features so novel-view-synthesis pretraining yields transferable geometry

    The authors present SNAP, a self-supervised encoder-decoder transformer in which a pose-free encoder aggregates frozen DINOv3 patch features via full cross-view self-attention, while a PRoPE pose-conditioned decoder with a BlockNN mask reduces target-view self-attention to a pointwise residual MLP and is trained to reconstruct frozen DINOv3 latent features with a first-order spatial finite-difference penalty; after training on roughly 117,000 sequences from RealEstate10K, DL3DV, and Co3Dv2, the frozen encoder matches or exceeds self-supervised baselines on point correspondence, visual localization, relative pose, relative depth, and MimicGen robot manipulation, and degrades more gracefully than 2D semantic encoders under camera shifts.

  9. arXiv

    Honeycomb stores scene memory in six fixed-size feature planes, lifting revisit consistency and novel-view synthesis on WorldScore and RealEstate10K

    The work introduces Honeycomb, a video world model built on HexMemory, a low-rank representation that stores scene features in a fixed-size memory of three spatial plus three spatiotemporal planes; a feed-forward writer maps each generated chunk into new plane features, warps the previous planes while preserving their dimensions, and fuses them via confidence-weighted pooling plus a learned residual correction, while a reader retrieves latents to condition subsequent generation; on WorldScore and RealEstate10K it reports stronger generation quality and revisit consistency with feature storage held constant throughout generation.

  10. arXiv

    GeoVerse injects video generative priors into geometric latent space, raising PSNR by 2.23 dB on DL3DV and cutting ATE by 32.4% on Mip-NeRF360

    GeoVerse performs diffusion generation inside the geometric latent space of a pretrained 3D foundation model (DA3), injects frozen Wan2.2 VACE video features into the denoiser through a ControlNet-style adapter, and uses a continuously updated colored point-cloud spatial memory to reproject history as target-aligned guidance, synthesizing cross-view consistent novel views from sparse inputs; across DL3DV, RealEstate10K, Mip-NeRF 360, and ScanNetV2 it reports better visual quality and geometric consistency, with PSNR 2.23 dB higher than GLD on DL3DV and ATE 32.4% lower than GLD on Mip-NeRF 360, while reflow distillation brings inference from over 100 seconds to under 10 seconds.