TrackEverything pushes dense 3D point tracking past 1000 frames by de-duplicating scene representations, beating open-source all-frame dense trackers by over 20% APD on short clips
TrackEverything represents videos as persistent 3D scene tracks in world coordinates and, through voxelization-based de-duplication at sliding-window boundaries, an endpoint-then-trajectory decomposition, and 3D WAFT feature sampling, becomes the first 3D tracker to follow all visible points across videos exceeding 1000 frames within 40 GB of GPU memory, outperforming all open-source all-frame dense 3D trackers by more than 20% APD on TAPVid-3D short clips while remaining competitive with state-of-the-art sparse trackers on long sequences.