Time-series foundation models can skip whole Transformer blocks: A100 latency drops 11% to 13% at moderate sparsity, with dataset-level variation
Two pretrained time-series foundation models skip whole Transformer blocks at inference, leaving mean forecasting quality nearly unchanged across 1,088 held-out windows while cutting median A100 batch-1 latency by 11.2% and 13.4% at moderate sparsity.