Skip to main content
Search

# Model Collaboration

5 related articles

Subscribe to updates
  1. Gemini

    Google releases Gemini 4 Hydrogen for everyday coding and agentic workflows, with flat pricing across a 1M-token context

    Google introduced Gemini 4 Hydrogen, a fast execution model for everyday coding and agentic workflows that complements the long-horizon reasoning models Gemini 4 Carbon and Argon. At its default high thinking level it scores 51 on the Artificial Analysis Intelligence Index versus Argon's 50, reaching 54 at the new xhigh setting; teams migrating from Gemini 3.8 Flash finish tasks 2.5 times faster, and Terminal-Bench 4.1 rises from 18.2% to 57%. Pricing is flat across its 1 million-token context at $1.50 per million input tokens and $7.50 per million output tokens.

  2. arXiv

    Two independently trained models stop flattening each other: constraining only task-score increments lifts six language tasks by 0.52 points on average

    Independently trained models hold complementary capabilities, yet knowledge transfer usually shrinks differences in predictions or representations, which erodes that complementarity. Corroborative Learning has each model learn only an increment to its task scores, then reconstructs those increments from the peer's representations on held-out data groups, constraining directions that reconstruct poorly more strongly. Across six language tasks, 24 models and 36 pairs, it improves on capacity-matched independent adaptation on all six tasks, with a mean gain of 0.52 percentage points, while both models still deploy independently at inference.

  3. arXiv

    Collaboration can backfire when modalities vanish: Lluna keeps a direct per-model prediction and gains 4.26% on average across eight datasets

    Collaboration among pretrained unimodal models can become less accurate than a surviving unimodal model when modalities are missing. Lluna keeps each model's direct prediction as a private path, adds a graph-based common branch as a residual correction, and lets richer availability states guide poorer ones along single-modality removal chains. Across eight datasets in affective computing, scene understanding and medical prediction, it improves Mean-Missing performance by 4.26% on average over the strongest evaluated baseline, with positive collaboration gains at minimal inputs on all eight tasks.

  4. arXiv

    A 14B model's reasoning gets split across 1.7B, 4B and 8B collaborators, beating it on all ten metrics

    A single large model that both generates and evaluates its own intermediate steps can favor its own outputs, letting errors propagate into later reasoning. A collaborative learning scheme replaces Qwen3-14B with three heterogeneous models of 1.7B, 4B and 8B under a 13.7B total parameter budget, using explicit task-state handoffs so different parameterizations reassess prior reasoning, then trains them with protocol distillation and step-level supervision to decide when to continue, hand off or terminate. Across ten metrics on five benchmarks, the heterogeneous system beats the original 14B model on all ten, with an average absolute gain of 2.38%, also surpassing a 24B homogeneous multi-agent baseline while using fewer model invocations than multi-agent frameworks.

  5. arXiv

    Draft-KV makes a receiver actually use the sharer's draft KV states: a 0.5B receiver rises from 37.45% to 78.04% on MMLU-Redux, and falls back to 36.40% when the message comes from an unrelated question

    The work first audits existing latent communication interfaces: across five method-dataset pairs, replacing each message with one from an unrelated question changes accuracy by at most 0.60 points even when communication adds 15.44 points over the receiver alone, indicating the gain can come from interface adaptation rather than message content; it then introduces Draft-KV, which sends the key-value states formed while the sharer drafts an answer through linear projections into a side memory read by a gated attention branch, trained progressively from message reconstruction to answer supervision under a one-sided guard on harm from mismatched messages, with both models frozen and only 1.05M interface parameters trained (348x fewer than C2C); with a Qwen3-8B sharer and a frozen Qwen2.5-0.

You’re all caught up