Skip to main content
Search

Université Paris Sciences et Lettres

3 related articles

Subscribe to updates
  1. arXiv

    How many bits a fine-tune must keep: the same dataset needs 1.03 bits per value on one frozen model and 0.41 on another

    The information a fine-tune writes into its adapter is now measured not by parameter count or weight reconstruction error but as the smallest serialized size of a compressed adapter that, reloaded into the frozen model, keeps 90% of the held-out fine-tuning gain. The same dataset demands very different rates across frozen models: keeping 90% of the math gain takes 1.03 bits per value on Qwen2.5-Math-7B but 0.41 on Qwen2.5-7B, and on an adapter trained with deliberately mismatched reasoning supervision, compression lifts GSM8K accuracy from 23.7% to 82.9%, above the frozen Qwen2.5-7B's 77.6%.

  2. arXiv

    Discrete diffusion need not pay for vocabulary size: masked and uniform noising both hit minimax rates on sparse data

    Discrete diffusion models have lacked the statistical theory that continuous diffusion enjoys, and it was unclear whether they can exploit sparse structure in the data distribution. This analysis casts masked-diffusion score estimation as a per-context label-smoothed classifier and shows the smoothing is equivalent to regularizing with the score loss of the uniform distribution. On sparse distributions where at most k sequences have positive probability, the terminal laws of both masked and uniform noising attain the sparse minimax rate, and the smoothing level can be chosen adaptively from the number of distinct training sequences without knowing the sparsity parameter.

  3. arXiv

    OTRetarget transfers contact relations from human demonstrations to a G1 humanoid, reaching 87% robot-object interaction Jaccard

    OTRetarget jointly retargets robot and multi-object motion by representing surface interactions through signed distances, closest surface points and relative directions, transferring these quantities across human, robot and object geometries with entropic optimal transport, and enforcing them in a per-frame constrained inverse kinematics that optimizes robot and object poses jointly; on OMOMO it reaches a robot-object interaction Jaccard of 87% and a depth error of 8.7 mm versus 28% and 29.3 mm for OmniRetarget, and transfers to a physical Unitree G1 for two-handed box pick-and-place onto a table.

You’re all caught up