Skip to main content
Search

National Taiwan University

7 related articles

Subscribe to updates
  1. arXiv

    Cepheid splits residual structure from physical scale: 15.6% and 10.1% lower completion error on unseen cloth and legged bodies than harmonic extension

    In sparse-to-dense mesh motion completion, residual priors trained on one geometry family often fail to beat parameter-free harmonic extension, because residual amplitude varies by more than an order of magnitude across families and densities while the target motion is unknown at test time. Cepheid learns only a dimensionless residual structure and recovers physical amplitude from observables plus a lightweight correction fitted on training sources. The unified model stays below harmonic extension on all five evaluated families, cutting error by 15.6% on an unseen cloth sheet and 10.1% on procedural legged bodies, without skeletons, registration, or cross-mesh correspondence.

  2. bioRxiv

    JuloVelo assigns each gene a kinetics pattern before training, resolving all five hippocampal neurogenesis branches

    JuloVelo moves gene kinetics pattern identification ahead of neural network training: each gene is first classified as Circle, Complete induction, or Complete repression from its unspliced–spliced RNA relationship, and training starts from pattern-matched pretrained weights, steering cell-specific kinetics away from biologically implausible parameter regimes. Across eight biological datasets spanning erythrogenesis, neurogenesis, and endocrinogenesis, plus simulated data with known kinetics, it was more stable than constant-rate and cell-specific models, was the only method to resolve all five hippocampal neurogenesis branches, and used promoter chromatin accessibility to process multiome data.

  3. aclanthology.org

    Autoregressive training drops strict left-to-right targets: Max(MI(S;t)) reorders by mutual information and lifts arithmetic accuracy to 94.96%

    Autoregressive language models normally learn next-token prediction in a fixed left-to-right order; Max(MI(S;t)) instead ranks target tokens by their mutual information with the source and already-selected targets before training, exposing informative targets earlier. On GPT-style models it reaches 94.96% average accuracy across arithmetic tasks, against 74.84% for next-token prediction and 86.29% for reverse order, close to the 97.33% upper bound from exhaustively testing 24 orders; on WikiText-2 it lowers average perplexity from 13.58 to 10.77. Only the training-target organization changes; architecture and autoregressive decoding stay the same.

  4. arXiv

    BLS refines task vectors at test time, letting zero-shot policies surpass OLS and online adaptation baselines on OGBench, DMC, and HumEnv

    The authors propose BLS, an offline zero-shot task-inference method for Behavioral Foundation Models that starts from an ordinary-least-squares (OLS) task vector and refines it with a soft-margin contrastive loss plus a trust-region loss to reduce both reward reconstruction error and successor-measure mismatch; they prove a suboptimality gap upper bound characterized by successor-measure and reward residuals, and empirically BLS outperforms OLS, ZOL, ReLA, and LoLA on average across five feature representations on OGBench (proprioceptive and pixel observations), 20 DMC tasks, and 45 HumEnv humanoid control tasks, with negligible inference overhead.

  5. arXiv

    TopK-Guided combines bounded token-level sparsity with sensitivity-aware block budgets, improving perplexity and downstream accuracy on Llama-2 and Llama-3

    TopK-Guided is a training-free activation sparsity method that combines bounded token-level sparsity adaptation with sensitivity-aware block-level budget allocation, consistently improving perplexity and downstream accuracy over TEAL and WINA across Llama-2 and Llama-3 models while preserving essentially the same sparsity-dependent projection compute as WINA, with the largest gains at high sparsity; ablations show the two components provide complementary improvements.

  6. arXiv

    EmoRES splits emotion vectors into shared and residual parts, lifting emotion hit rate by up to 12.95 points on IndexTTS-2 and CosyVoice2

    The work proposes EmoRES, a training-free method that discovers that an emotion steering vector decomposes into a shared component moving speech away from neutral expression and a residual component directing generation toward the requested emotion, and controls the two independently; on IEMOCAP, EmoRES outperforms CoCoEmo across all four objective emotion metrics on the frozen IndexTTS-2 and CosyVoice2 backbones, improving rank correlation by 26.13 and 12.97 percentage points and emotion hit rate by 12.95 and 6.92 points, with human evaluation showing up to 35.0% relative improvement in listeners correctly identifying the dominant requested emotion and up to 63.8% naturalness preference in pairwise comparisons.

  7. arXiv

    Tri-PvP's 8,000 tri-modal conflict samples show omni-modal LLMs favor images, and favor perceptual vision but propositional audio

    The authors built Tri-PvP, an 8,000-sample tri-modal conflict benchmark spanning animal, emotion, environment, and music domains in which image and audio each appear in perceptual form (real photographs or recordings) or propositional form (text-card images or TTS speech) while text is always propositional, evaluated five omni-modal LLMs across four evidence-type conditions, and found that image bias dominates in 18 of 20 model-by-condition bars and that a systematic asymmetry exists: models favor perceptual evidence in vision but propositional evidence in audio, with this bias linearly decodable from early hidden layers and only partially mitigated by contrastive decoding, which introduces a residual text bias.

You’re all caught up