Skip to main content
Search

# SpecSlot

1 related articles

Subscribe to updates
  1. arXiv

    Pixel-space generators stop letting detail inflate global attention: low-frequency carriers cut ImageNet-512 FID by 2.84

    Pixel-space generators feed the full image to a Transformer as patches, so finer detail lengthens the global sequence and raises quadratic attention cost, tying detail to communication. SpecSlot expands each spatial anchor into slots, gives every slot a fixed disjoint group of DCT coefficients, and sends only the lowest-frequency slot per anchor into the global stage while all slots mix locally. At ImageNet-512, the W256/K4 configuration lowers FID by 2.84 over the FLOPs-matched JiT control with 3.9% fewer GFLOPs, and trails JiT-B/16 by 0.69 FID at 38.2% lower cost.

You’re all caught up