# LLM serving optimization

Fireworks has added 3D FireOptimizer to its FireOptimizer tuning stack, a tool that automatically searches configurations spanning model architecture, quantization, speculation, hardware and parallelism. LLM serving must balance speed, throughput cost and quality, and because every knob affects the others the space exceeds 100,000 combinations. The tool prunes that space using production performance sweeps, heuristics and precomputed profiles, then takes a workload's characteristics and SLAs and returns a few candidate configurations; in three case studies, endpoints it produced gave a better QPS-versus-latency tradeoff than the public-platform baseline at the same quality bar.

Fireworks has added 3D FireOptimizer to its FireOptimizer tuning stack, a tool that automatically searches configurations spanning model architecture, quantization, speculation, hardware and parallelism. LLM serving must balance speed, throughput cost and quality, and because every knob affects the others the space exceeds 100,000 combinations. The tool prunes that space using production performance sweeps, heuristics and precomputed profiles, then takes a workload's characteristics and SLAs and returns a few candidate configurations; in three case studies, endpoints it produced gave a better QPS-versus-latency tradeoff than the public-platform baseline at the same quality bar.