Skip to main content
Search

# Tideway

1 related articles

Subscribe to updates
  1. arXiv

    Frontier MoE models on a consumer PC no longer lean on the SSD: Tideway pools VRAM and RAM for a 1.97x average end-to-end speedup

    Tideway merges a consumer PC's GPU VRAM and host RAM into one unified memory pool and lays out expert weights separately for the prefill and decode phases, so frontier MoE models that exceed VRAM need not repeatedly reload weights from the SSD. On an RTX 5090 with 16–128 GiB host-RAM budgets, across 270 fixed-shape configurations of Qwen3.6-35B-A3B, Gemma4-26B-A4B and DeepSeek-V4-Flash, it delivers a 1.97x average and up to 3.18x end-to-end speedup, 2.40x average on time-to-first-token and 1.61x average on time-per-output-token; on replays of eight multi-turn coding-agent sessions it cuts total request processing time by up to 3.14x.

You’re all caught up