The research question addresses whether generalist AI models can control robotic manipulators more reliably than specialist policies like vision-language-action models (VLAs) and world-action models (WAMs) without requiring task-specific training or demonstrations.
The authors propose agentic manipulation policies (AMPs), where a generalist AI model directly commands the manipulator, adapting its actions dynamically as the task progresses. They introduce AMP1, a versatile system that works across different types of manipulation tasks, including single-arm, bimanual, and mobile manipulation.
The authors report that AMP1 achieves top results on the RoboLab-120 and CaP-Gym benchmarks without any demonstrations or task-specific training. In real-world tests, AMP1 succeeds in 104 out of 108 trials across twelve tasks and three robots, significantly reducing failure rates compared to VLAs and WAMs. An enhanced version of AMP1 with a memory component further improves performance on bimanual manipulation tasks.