Yuan Meng

The work proposes a Bayesian non-parametric skill prior built on a Dirichlet Process Mixture that models temporally extended skills in a structured latent space, enabling adaptive skill discovery without predefining the number of components; integrated into a hierarchical RL framework, the learned prior guides high-level skill selection while a pretrained decoder generates temporally abstracted actions, and experiments on Franka Kitchen, LIBERO-Long, Meta-World, and a real robot show consistent gains in long-horizon manipulation, achieving over 0.8 success rate within 1.5M steps whereas SAC fails to converge even after 5M steps (below 0.1), with an average improvement of 21.8% over a single-Gaussian prior baseline.

The work proposes a Bayesian non-parametric skill prior built on a Dirichlet Process Mixture that models temporally extended skills in a structured latent space, enabling adaptive skill discovery without predefining the number of components; integrated into a hierarchical RL framework, the learned prior guides high-level skill selection while a pretrained decoder generates temporally abstracted actions, and experiments on Franka Kitchen, LIBERO-Long, Meta-World, and a real robot show consistent gains in long-horizon manipulation, achieving over 0.8 success rate within 1.5M steps whereas SAC fails to converge even after 5M steps (below 0.1), with an average improvement of 21.8% over a single-Gaussian prior baseline.