NVIDIA's open multimodal model lands on SGLang day one: 120B parameters, 12B active, 243.9 tok/s on one GPU
NVIDIA released Nemotron 3.5 Super VL, an open multimodal model that takes text, images, documents and video and returns text for always-on agents that read screens, documents and tools. SGLang supports deployment from day one, serving it with continuous batching, prefix caching and speculative decoding. The mixture-of-experts model has 120 billion total parameters and activates 12 billion per token, with built-in multi-token prediction; it reaches 243.9 tok/s on a single RTX 6000 PRO.