Representation-Guided Generation and Integration of Executable Programs for Robot Manipulation

Published 2026-09-28Automatically prepared brief

This paper introduces RIVET, a framework that uses a shared object-centric representation to generate and integrate executable programs for robotic manipulation tasks.

The research question addresses the challenge of building robotic manipulation systems by connecting perception, planning, and control through compatible representations and interfaces, especially when using VLM code generation.

The proposed approach, RIVET, integrates VLM-generated programs by leveraging a shared object-centric representation that includes per-object 6D poses and a relation graph, enabling the generation of cooperating perception, rendering, relation-inference, and planning programs.

The authors report evaluating RIVET on tasks like cube stacking, tangram rearrangement, and 3D assembly in both simulation and on a physical robot, achieving an 83% overall success rate with offline-generated systems.

About this brief

This article summarizes a public preprint abstract. Its findings have not been independently reproduced for this publication. Consult the paper for methods, evaluation scope and limitations. Automated briefs may contain errors; the original source takes precedence.