InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation

Published 2026-10-04Automatically prepared brief

InterEvolve explores evolving reward programs at test time to enable humanoid robots to perform tasks they were not trained for, leveraging their existing skills and learning from attempts without retraining.

The research question addresses how humanoid robots can solve new tasks at test time by repurposing their existing skills and learning from their experiences without the need for retraining.

The proposed approach involves developing an object-aware forward-backward (FB) behavioral foundation model that translates new rewards into loco-manipulation behaviors, and specifying tasks as reward programs with staged rewards and tunable constants. A large language model (LLM) agent revises these programs based on execution feedback and a skill library, while a numerical optimizer adjusts the constants.

The authors report that experiments show human-designed rewards often fail to utilize the full potential of the FB model's capabilities, whereas the evolved reward programs in InterEvolve can unlock this potential, sometimes through innovative strategies. These programs generate behaviors for various tasks and complex scenes in simulations and can be executed autonomously on a physical Unitree G1 robot.

About this brief

This article summarizes a public preprint abstract. Its findings have not been independently reproduced for this publication. Consult the paper for methods, evaluation scope and limitations. Automated briefs may contain errors; the original source takes precedence.