Respan rewrites its AI gateway in Rust with a tiny core, so every provider and feature is a plugin
Respan released an open-source Rust AI gateway that makes providers, protocols, modalities and reliability features all plugins, leaving the core to dispatch events. The team had wrapped LiteLLM in more than 100,000 lines of code, and after a routine upgrade caused intermittent connection errors and a rollback whose cause is still unknown, it rebuilt the gateway. Adding a provider now takes a short file, 22 lines for Mistral, with each quirk tested separately.