Skip to main content
Search

# Multimodal Reasoning

6 related articles

Subscribe to updates
  1. Mistral Blog

    Mistral Large 4 opens as a public preview: 1 trillion parameters, 49 billion active, and 82% on a cyber vulnerability test

    Mistral released a public preview of Mistral Large 4, a natively multimodal model with 1 trillion total parameters and 49 billion active parameters, with weights promised by the end of the month. Open-weight models have generally trailed the strongest closed frontier models on enterprise tasks such as cybersecurity, finance and law; Mistral says ML4 is state of the art among open models in those areas and edges GPT-6-Astra on the Dense 200 visual-grounding test, 42% versus 41%. On one Artificial Analysis Cyber Index test that asks a model to reproduce a real vulnerability and then patch it, ML4 scores 82%, the highest of any model.

  2. Mistral Blog

    Mistral Opens Weights of Its Trillion-Parameter Model: Coding Agents Use 47% Fewer Tokens, Terminal Tasks Gain 13 Points

    Mistral AI has released the weights of its flagship Mistral Large 4 (Le Chonk), a trillion-parameter natively multimodal model improved by three more weeks of reinforcement learning after its public preview. On the Artificial Analysis Coding Agent Index it scores 48%, effectively tied with leading open-weight model GLM-5.3 while using 47% fewer tokens per task on average; on Terminal-Bench 4.0 it gains 13 percentage points over its own preview to 41% with 30% fewer output tokens. Three reasoning modes let developers trade performance against inference cost.

  3. Apertus 1.5 folds images and audio into the text vocabulary: same architecture, 8B and 70B weights open under Apache 2.0

    Switzerland's Apertus project released 1.5 versions of its 8B and 70B models, continuing pretraining from 1.0 to add image and audio understanding, an optional thinking mode, and a context window of 262,144 tokens. Multimodality arrives by early fusion: images and audio become discrete tokens placed in the same sequence as text, with no separate vision encoder, so the architecture is unchanged and training runs at text-only speed. The models read images and audio but generate only text, speech handling remains experimental, and the project says the release still trails frontier open-weight models.

  4. NVIDIA opens a 120B multimodal model for agents: up to 5x throughput on one GPU, post-trainable on your own data

    NVIDIA released Nemotron 3.5 Super VL, an open, customizable multimodal model for long enterprise agent workflows that need reasoning, tool use, and text, image, document, and video understanding. It uses a 120B-parameter mixture-of-experts architecture that activates 12B parameters per token, and NVIDIA reports up to 5x higher throughput on agentic tasks than other open models in its size class on a single GPU. Teams can post-train it with NeMo on their own data, tools, and workflows, and NVIDIA also released agentic tool-use, finance reasoning, and 40 vision-language datasets.

  5. arXiv

    Scaffolding Minds swaps in a learnable scaffolding encoder and an adaptive Gaussian sampler for latent visual reasoning, gaining 9.5 points on FrozenLake and 5.6 points across nine visual reasoning benchmarks

    The work proposes Scaffolding Minds, a two-stage framework in which Stage 1 replaces the frozen off-the-shelf vision encoder with a scaffolding encoder trained end-to-end through the downstream task loss to produce the latent target, and Stage 2 replaces deterministic latent regularization with a Gaussian sampler whose mean and variance are learned so that residual latent actions can be sampled for RL exploration, improving over the strongest latent-reasoning baseline by 9.5 points on average on FrozenLake (19 points at Level 32) and by 5.6 points on average across nine visual-centric reasoning benchmarks.

  6. arXiv

    SCOPD lifts VLM performance at 10% visual-token retention from 86.37% to 92.43% via sparse-context on-policy self-distillation

    Using a fixed-context Pass@K analysis, this work shows that degradation after visual-token pruning is not only lost information but also unreliable use of surviving evidence (a representation-utilization gap), and introduces SCOPD and SCOPD+ sparse-context on-policy self-distillation, raising the normalized average over 13 benchmarks at 10% visual-token retention from 86.37% (Vanilla) to 90.49% and 92.43% without architectural changes, extra inference-time computation, or ground-truth answers.

You’re all caught up