Skip to main content
Search

# Disentangled Representation Learning

3 related articles

Subscribe to updates
  1. bioRxiv

    Single-cell perturbation prediction stops chasing the average: scDisentangle keeps each cell's identity in its counterfactuals

    Single-cell perturbation-response prediction has struggled to beat simple mean baselines, and population-average metrics cannot show whether a prediction keeps the source cell's identity. scDisentangle splits each cell's expression into attribute embeddings and a sequence of residual factors extracted one after another, then generates counterfactuals at inference by replacing only the attribute embeddings while holding cell-specific factors fixed. On interferon stimulation, liver infection and unseen combinatorial genetic perturbations it beat the models and mean baselines compared in each benchmark, and in a myocarditis cohort it predicted donor-specific heart-infiltrating CD8+ T cell states from peripheral blood.

  2. arXiv

    LinSlot uses the linear representation hypothesis to split slot representations into objects and attributes, beating baselines on DCI and FG-ARI

    LinSlot introduces a probabilistic generative model linking images, slots (objects) and blocks (attributes), imposes the linear representation hypothesis in both object and attribute spaces, and infers attributes from slots via block attention; on CLEVR-Easy, CLEVR-Hard and CLEVR-Tex it improves DCI and FG-ARI over slot attention, SLATE+ and SysBinder baselines, while providing evidence for global delta directions in slot space.

  3. arXiv

    DSReg provably recovers individual world latents without reconstruction, improving sparse control and editing across synthetic, pixel-trained, and external-renderer benchmarks

    The work introduces DSReg (Dependency-Sparsity Regularization), which, on top of the linear-identifiability premise provided by LeJEPA, proves that under Structural Diversity—distinct dependency footprints of latents on observations—each world latent can be recovered up to signed permutation with no reconstruction, no decoder, and no labels; the method applies post hoc to any linearly identified representation, reuses trained checkpoints, and across synthetic regimes, world-model probes, pixel-trained encoders, and external renderers preserves dense prediction while improving individual-latent recovery and downstream sparse control, editing, and few-shot readout.

You’re all caught up