Skip to main content
Search

# Draft-KV

1 related articles

Subscribe to updates
  1. arXiv

    Draft-KV makes a receiver actually use the sharer's draft KV states: a 0.5B receiver rises from 37.45% to 78.04% on MMLU-Redux, and falls back to 36.40% when the message comes from an unrelated question

    The work first audits existing latent communication interfaces: across five method-dataset pairs, replacing each message with one from an unrelated question changes accuracy by at most 0.60 points even when communication adds 15.44 points over the receiver alone, indicating the gain can come from interface adaptation rather than message content; it then introduces Draft-KV, which sends the key-value states formed while the sharer drafts an answer through linear projections into a side memory read by a gated attention branch, trained progressively from message reconstruction to answer supervision under a one-sided guard on harm from mismatched messages, with both models frozen and only 1.05M interface parameters trained (348x fewer than C2C); with a Qwen3-8B sharer and a frozen Qwen2.5-0.

You’re all caught up