# Adaptive Speculative Execution

Fireworks has added adaptive speculative execution to FireOptimizer, training the draft model for speculative decoding on a customer's own inference workload instead of generic conversation data. Speculative decoding lets a smaller draft model predict several tokens in parallel for the main model to verify, so the draft's hit rate sets the payoff; generic drafts hit poorly on specialized workloads. In one specialized case a generic draft hit 29% and raised latency 1.5x, while FireOptimizer reached a 76% hit rate and 2x speedup, up to 3x over a generic draft model.

Fireworks has added adaptive speculative execution to FireOptimizer, training the draft model for speculative decoding on a customer's own inference workload instead of generic conversation data. Speculative decoding lets a smaller draft model predict several tokens in parallel for the main model to verify, so the draft's hit rate sets the payoff; generic drafts hit poorly on specialized workloads. In one specialized case a generic draft hit 29% and raised latency 1.5x, while FireOptimizer reached a 76% hit rate and 2x speedup, up to 3x over a generic draft model.