Skip to main content
Search

Korea Advanced Institute of Science and Technology

31 related articles

Subscribe to updates
  1. arXiv

    Composed image retrieval stops squeezing queries into one vector: FactEmbed decomposes the edit first, then reranks candidates

    Composed image retrieval takes a reference image plus a modification text and must return the target image, and the common recipe compresses that multimodal query straight into one retrieval vector, leaving the model no explicit chance to work out what the text changes. FactEmbed inserts a set of learnable factorized latents into Qwen2.5-VL-7B's input and trains them with a target-imagination objective that reconstructs target details, so each latent grounds a semantic region, then carries that decomposition into retrieval through a factor-level contrastive loss and attention distillation. On the refined CIRR and FashionIQ benchmarks it scores above both CSMCIR and ReCALL on Recall@1 and average Recall@10, though the improvement margins stated in the text do not match the table values.

  2. arXiv

    Search interfaces stop being hand-fixed: SearchWeaver rewrites tools and instructions per corpus, lifting answer accuracy from 71.6% to 78.4%

    How well a language-model agent searches depends on the interface it is given, yet existing interfaces are set by hand and applied unchanged to every corpus. SearchWeaver jointly revises corpus artifacts, executable tools and usage instructions using the agent's execution trajectories and task rewards, then selects by downstream search performance. With GPT-5.4-nano, the optimized interfaces raise BrowseComp-Plus answer accuracy from 71.6% to 78.4% and average nDCG@10 across four BRIGHT subsets from 45.7 to 55.0, while cutting tool execution time.

  3. arXiv

    VLA action chunks get a validity check before execution: PAV predicts each prefix's outcome and lifts LIBERO average success to 94.65%

    Vision-language-action (VLA) policies emit a whole action sequence per query, but how much of it to execute was previously judged only indirectly, through generation stability or prediction agreement. PAV instead predicts, inside the policy's own task-conditioned representation, what a candidate prefix will lead to, and a verifier trained on trajectory-level outcomes scores whether the task can still be completed. On the four LIBERO suites, PAV averages 94.65% success at 14.0 policy queries per episode, above direct verification without future prediction (84.55%, 22.3 queries) and prediction in DINOv2 features (87.00%, 22.2 queries).

  4. arXiv

    Long-Tailed Recognition Drops the Uniform Collapse Target: Tail Classes Keep Their Spread and Four Benchmarks Beat Prior Methods in Overall Accuracy

    Long-tailed recognition no longer treats every class alike. Prior methods pulled all features onto one fixed equiangular tight frame, a shared target whose directions make equal angles, and that full collapse over-contracts tail samples and weakens generalization. Head classes still collapse onto the frame while tail classes keep within-class diversity: a feature-conditioned gating classifier specializes nodes so tail classes take their own directions, and a frequency-adaptive margin shrinks for head classes and grows for tail classes. On CIFAR100-LT, ImageNet-LT, Places-LT and iNaturalist-2018, overall accuracy beats prior methods, and within-class spread rises monotonically from head to tail.

  5. arXiv

    Two-bit lookup tables shrink DeepSeek's 203 GB memory to 51 GB and cut prefill from 64.66 s to 13.27 s

    Conditional memory lets a language model add capacity through lookup, but the whole embedding table must stay resident; DeepSeek's table alone is 203 GB. Conditional Program stores each row as a short code plus a local scale and reconstructs it with a Gaussian trellis shared across the table, decoding only the rows an input requests. At two bits, storage falls roughly four- to eightfold, most reported task scores stay close to their originals, and output KL is 41–63% lower than 2-bit round-to-nearest.

  6. arXiv

    GUI agents stop rebuilding future screens: latent prediction lifts success up to 40.6% and cuts world-model latency by 98.9%

    GUI agents no longer reconstruct the next screen pixel by pixel; a shared latent representation now scores candidate actions and predicts action-conditioned futures at once, raising success rates by up to 31.9% offline and 40.6% online relative to pixel-space world models while cutting world-model inference latency by up to 98.9%.

  7. arXiv

    Before the story is written, event types are decodable: four open-weight models look ahead at least four events, but only the next one beats text-only prediction

    Across four 24–32B open-weight models, hidden states at event ends decode the state-change type of at least four upcoming events, yet only the next event significantly beats text-only predictors; in OLMo, sustained steering along that direction shifts subsequent event composition in both directions.

  8. arXiv

    One-step generation stops drifting on minibatch proportions: swapping hard marginal constraints for soft penalties cuts CIFAR-10 FID from 8.10 to 4.51

    UW-Flow replaces W-Flow's balanced Sinkhorn energy with a debiased unbalanced Sinkhorn divergence, reducing finite-batch velocity error and improving generation on MNIST, CIFAR-10, and ImageNet-100 under matched training budgets.

  9. arXiv

    Reasoning correction without retraining: injecting the instruction as a new user turn lifts average accuracy from 37.1% to 55.3% across four reasoners

    Across four reasoners and six math benchmarks, injecting a correction instruction as a new user turn at a learned cut position raises average accuracy from 37.1% to 55.3% while the reasoner itself stays frozen.

  10. arXiv

    CRD distills reasoning via multi-teacher cross-feedback and step-level stitching, reaching 97.3% on MATH-500 and 70.3% on AIME'25 with a 4B student trained on only 50K examples

    The work proposes Collaborative Reasoning Distillation (CRD), in which DeepSeek-R1 and Gemini 2.5 Flash Thinking iteratively critique each other's reasoning, a dual-judge system scores each step's logical validity independently of the final answer, and a Viterbi-style coherence-aware algorithm stitches high-quality steps across teachers; students are trained with Reasoning Quality Optimization under curriculum budget constraints, and CRD-4B reaches 97.3% on MATH-500 and 70.3% on AIME'25 using only 50K training examples.