Skip to main content
Search

# Weight-Space Programming

7 related articles

Subscribe to updates
  1. arXiv

    A language model writes an EEG network without a single gradient step: all 2,730 weights by hand, 0.834 balanced accuracy from five subjects

    Weight-space programming lets a language model read and edit a trained network's weights directly, and had been shown on game-playing networks and language models. Applied to EEG and ECG models, Claude Opus 5.5 wrote all 2,730 weights of TinyEEGNet with no gradient step and only five practice subjects, reaching 0.834 balanced accuracy on 65 unseen subjects, on par with 0.806 for the same architecture trained on 30 subjects and above 0.704 trained on five; it could not infer a network's task from its weights, nor improve an already well-trained network.

  2. arXiv

    GPT-6 Astra writes variational quantum circuit angles directly: no optimizer, 95–100% of the VQE spectrum

    Variational quantum algorithms normally rely on a classical optimizer to tune gate angles, and every loss evaluation is a run of the quantum device. A study has the frontier model GPT-6 Astra write the angles directly from the problem, circuit and gate conventions, with no loss or gradient returned; on transverse-field Ising chains, H2 and depth-one QAOA its angles match the optimizer, and as a warm start they cut the median optimizer evaluations to best value down to one.

  3. arXiv

    Auditing clinical prediction networks without their weights: GPT-6 Astra recovers every planted relationship up to 38,401 weights once given a calculator

    Clinical prediction models often arrive as files without the data they were trained on, so an auditor must work out what the model actually computes. Researchers trained tanh networks of 105 to 38,401 weights on simulated subarachnoid haemorrhage cohorts, planted known relationships or a label bias, and asked GPT-6 Astra to answer with no tools, with a calculation-only white-box tool, or with a black-box tool exposing only predictions. Without tools Astra recovered planted relationships in 353-weight networks but became unreliable at 3,457 weights; with the calculator it recovered the relationship in all 29 runs that had one, raised no false alarm in 15 null runs, and black-box matched white-box.

  4. arXiv

    An LLM wrote a medical image classifier without seeing one image, but 256 labeled scans still beat it on every task

    Claude Opus 5.5 and GPT-6 Astra each wrote the weights of a small convolutional network in a single reply, without access to any image, reaching mean test AUC of 0.719 and 0.711 across six MedMNIST tasks, above zero-shot MedSigLIP at 0.588. Yet the same network trained with Adam on 256 labeled images reached a mean AUC of 0.828 and was higher on every MedMNIST task; on the synthetic uterine MRI task Opus reached 0.764 while Astra fell to 0.136 through a systematic error.

  5. arXiv

    A robot policy misread "in the bowl": closed-form weight edits, with no retraining or instruction change, lift held-out success from 27/128 to 106/128

    A zero-shot vision-language-action policy told to put the cube then the banana in the bowl releases the cube early because it binds "in the bowl" to the banana rather than the cube in its gripper. Closed-form instruction distillation writes the per-layer effect of a working rewording directly into the VLM's MLP weights, with no gradients, training data or change to the instruction; on 128 held-out seeds success rises from 27/128 to 106/128, while a random-direction update of the same size leaves success unchanged.

  6. arXiv

    IWIBench lets large models rewrite a small model's weights: structured output scores zero across all ten editors, while alias edits hit the ceiling

    IWIBench turns gradient-free behavioural weight editing into a scored, controlled task: an editor model gets only four tools for reading and writing weights, running the target and inspecting it, and must make ten kinds of semantic change to Gemma 3 4B IT, after which fresh processes compare target success and control retention before and after the patch. Across ten configurations on the same thirty episodes, 6.1-sol at medium reasoning leads with a macro reward of 0.4601 and Astra follows at 0.4356; no editor scores on structured-response defaults, and only 5.6-terra earns positive reward on answer-length control.

  7. arXiv

    An LLM wrote the weights of small scoring networks: 0.37× SCIP's default on independent set, but bus-crew gains came from a rule SCIP already ships

    An empirical study tests whether a large language model can write the weights of small scoring networks directly, without gradient training and guided only by forward-pass outputs, to speed up exact algorithms such as column generation and branch-and-bound. On synthetic independent-set instances the written branching rule took 0.37 the time of SCIP's default and matched or beat networks trained by imitation of strong branching on the same features; on a bus-driver scheduling model built from Atlanta transit data, the 0.63 time ratio was fully reproduced by SCIP's own plain pseudocost rule at 0.99.

You’re all caught up