Mikhail Dereviannykh

SemanTok is a flexible-length video tokenizer that feeds frozen DINOv2 features into its encoder and adds lightweight heads that reconstruct those features from each retained token prefix alone, letting a 201M autoregressive model match or beat a VideoFlexTok model 3.4 times its size and improving semantic alignment at every noise level, including pure noise.

SemanTok is a flexible-length video tokenizer that feeds frozen DINOv2 features into its encoder and adds lightweight heads that reconstruct those features from each retained token prefix alone, letting a 201M autoregressive model match or beat a VideoFlexTok model 3.4 times its size and improving semantic alignment at every noise level, including pure noise.