Skip to main content
Search

Durham University

3 related articles

Subscribe to updates
  1. arXiv

    SGD convergence rates can be transferred: one Lyapunov calculation on a diffusion, then carried back window by window

    Finite-time convergence bounds for stochastic gradient algorithms can be transferred from Lyapunov estimates for an associated stochastic differential equation, recovering known rates for strongly convex SGD and stochastic Heavy Ball.

  2. arXiv

    MAGEFormer embeds voxel spacing into positional encoding and attention, reaching the lowest HD95 on anisotropic abdominal CT segmentation across BTCV and FLARE 22

    The authors propose MAGEFormer, which embeds physical spacing constraints into representation learning: MASE calibrates positional frequencies by voxel spacing, GCA suppresses physically implausible cross-scale feature correlations, and GVV performs deterministic sub-voxel view aggregation at inference; under a unified 5-fold protocol on BTCV and FLARE 22 it attains the strongest boundary accuracy among compared methods (10.58 mm and 3.40 mm HD95) with consistent Dice gains, and its advantage grows with anisotropy severity.

  3. arXiv

    Decision Titan adds test-time training layers to a Decision Transformer and learns long-term dependencies 20x longer than its context window in X-Maze

    The work augments a Decision Transformer with Test-Time Training (TTT) layers, forming Decision Titan, and analyzes its performance and memory mechanism in the X-Maze environment built to test sequential memory: the model learns long-term dependencies with ranges 20x longer than the context window and generalizes to lengths 1.7x the training data, but temporal generalization depends on the time embeddings used and the ability to learn long-term dependencies depends on how the relevant information is encoded.

You’re all caught up