Skip to main content
Search

# Successor Representation

2 related articles

Subscribe to updates
  1. bioRxiv

    Why place cells fire in many fields across large spaces: a hierarchical predictive map ties field statistics to the scale of behavior

    In large environments at naturalistic scale, rat and bat hippocampal CA1 place cells often carry multiple irregularly spaced firing fields, whereas the classical single-scale successor representation holds only in small enclosures. The factorised hierarchical successor representation (fHSR) folds one-step actions together with subgoal-directed subroutines into a predictive map, then decomposes the maps of several tasks into a non-negative overcomplete basis that gives each model cell its tuning. On a 48 m rat track and a 200 m bat track the model reproduced the gamma-Poisson overdispersion of field counts, and it predicted a spatial periodicity of population activity whose wavelength is independent of track length, a prediction tested in rat data.

  2. arXiv

    Temporal abstraction is shown to align the spectrum of forward-backward representations, stabilizing learning at high discount factors in continuous control

    The work analyzes temporal abstraction as a mechanism to mitigate the spectral mismatch in forward-backward (FB) representations, showing by characterizing the spectral properties of the transition operator that temporal abstraction acts analogously to a low-pass filter suppressing high-frequency spectral components, thereby reducing the effective rank of the induced successor representation while preserving a formal bound on the value function error, and empirically showing that this alignment is a key factor for stable FB learning at high discount factors.

You’re all caught up