The research aims to address the gap in personalized robotic manipulation (PeRM) by developing a benchmark called LIBERO-PeRM. It explores how policies adhere to preferences in various scenarios, including zero-shot settings, learning from demonstrations, and generalizing across different layouts and tasks.
The authors propose a controlled framework for defining observable preferences in simulation, encompassing motion, skill, and user-profile choices. They generate paired demonstrations with and without preferences using a procedural pipeline, creating a dataset with high-quality demonstrations and preference metrics.
Experiments conducted by the authors reveal that existing value learning algorithms (VLA) face challenges in zero-shot personalization, whereas supervised fine-tuning (SFT) enables preference learning. Mixed training methods show improved performance with contextual prompts but may affect motion-preference learning. Preference generalization, decomposition, and conflict resolution remain areas needing further development.