Skip to main content
Search

# LeJEPA

3 related articles

Subscribe to updates
  1. arXiv

    Two encoders no longer share one space: DuoJEPA adds a single translator layer and lifts chest-radiograph zero-shot AUC from 60.0 to 86.6

    Paired modalities are usually used to pull two encoders into one shared embedding space. DuoJEPA instead keeps a separate LeJEPA self-supervised space per modality and appends to each encoder one residual-free transformer layer that translates its embedding into the other encoder's space, trained by a contrastive loss computed entirely within that target space. On CheXpert Plus chest radiographs and reports it reaches a zero-shot AUC of 86.6 and a cross-modal retrieval score of 78.5, against 60.0 and 64.2 for a reimplementation of LeVLJEPA with the same encoders and data, while a paired-cosine test detects no direct alignment between the two own spaces.

  2. For invisible inhaled objects, the AI stops giving a probability and points to a bronchial segment, lifting sensitivity from 18.8% to 56.3%

    Radiolucent foreign body aspiration in adults sits at soft-tissue and mucus density on CT, so it has been found only by slice-by-slice manual reading and is easily missed. AI-PACS instead learns a standard Gaussian manifold of non-FBA airway topology from 804 unlabelled CT scans, flags deviations from that manifold as anomalies, and maps them onto the S1–S10 bronchial segments. In a 35-patient human-AI subset, sensitivity rose from 18.8% for radiologists to 56.3%, and average negative-exclusion screening time fell by about 75%.

  3. arXiv

    DSReg provably recovers individual world latents without reconstruction, improving sparse control and editing across synthetic, pixel-trained, and external-renderer benchmarks

    The work introduces DSReg (Dependency-Sparsity Regularization), which, on top of the linear-identifiability premise provided by LeJEPA, proves that under Structural Diversity—distinct dependency footprints of latents on observations—each world latent can be recovered up to signed permutation with no reconstruction, no decoder, and no labels; the method applies post hoc to any linearly identified representation, reuses trained checkpoints, and across synthetic regimes, world-model probes, pixel-trained encoders, and external renderers preserves dense prediction while improving individual-latent recovery and downstream sparse control, editing, and few-shot readout.

You’re all caught up