Skip to main content
Search

# Net Utility

1 related articles

Subscribe to updates
  1. arXiv

    Samsung Research's Net Utility allocates LoRA merging rank budgets per singular direction, lifting vision tasks by 2.1% and language tasks by 2.2% on average

    The work identifies the uniform assumption that every layer and every task receives the same rank budget as a major source of the gap between merged and per-task LoRAs, and introduces Net Utility, a data-free metric that decomposes each task LoRA by SVD, scores every singular direction by its benefit to its own task minus its interference with other tasks, and then globally selects the highest-scoring directions under a total rank budget; applied on top of five merging methods across three merging spaces on 7 vision and 6 language tasks, it improves performance by 2.1% on average for vision and 2.2% for language.

You’re all caught up