The research question addresses the challenge of learning dexterous manipulation from limited visual demonstrations, where policies need to develop both perceptual understanding and precise control. Traditional reinforcement learning in simulation can achieve this but requires extensive interaction and privileged information.

The proposed approach, Latent RL Prior, consists of two stages. First, during privileged pretraining, large-scale RL rollouts are distilled into a flow-matching action decoder that uses proprioception and latent task context. In the second stage, during visual adaptation, the decoder remains fixed while a visual interface is learned to map images to the latent context using only action supervision.

The authors report that their method outperforms other approaches in low-data scenarios across three simulated tasks. Specifically, it surpasses full-parameter fine-tuning and GR00T N1.7 baselines with significantly fewer demonstrations. Analysis indicates that direct visual-to-latent conditioning enhances adaptation and stability compared to using a pretrained state encoder.