Cleave decouples algebraic search from operator scheduling to generate fused kernels up to 2.8x faster than the best baseline on LLM subgraphs
Cleave is an ML compiler built on symbolic decoupling: it discovers algebraic transformations by superoptimizing over graphs with symbolic shapes, then schedules each resulting graph on concrete shapes, fusing graphs with multiple reductions through iterative tiling and horizontal fusion; on common LLM subgraphs it generates kernels up to 2.8x faster than the best baseline (1.6x on average) and cuts compilation time by 5.9x on average versus Mirage.