Kernel solvers stop choking on preconditioner memory: sketched blocks push model size to ten million parameters with better accuracy
The preconditioner memory of kernel ridge regression no longer grows with model size, letting Bloks scale to ten million parameters and match or beat state-of-the-art accuracy on large-scale benchmarks such as Higgs.