IBM Puts Chat, Decisions and Speech Behind One Endpoint: Three Adapters Share a KV Cache, VRAM Barely Moves
IBM released Granite Switch 4.1, which composes general decision-making, safety decision-making and speech transcription into a single hosted endpoint, with 8B and 30B versions occupying roughly the same GPU VRAM as the base model alone. The earlier Granite Switch project already allowed users to compose specialized adapters into custom models, while this release ships a Decision adapter, a Guardian safety adapter and Granite-Speech-5.0-Turbo-CTC precompiled into the model. Because the adapters are built as cache-efficient Activated LoRAs, the KV cache produced by a base-model generation can be reused for later adapter-based decisions, so switching between chat, decision and spoken requests does not rebuild the cache.