RESCUE: Evaluating the Value of Monitor Alarms in Robot Policies
Automatically prepared brief
RESCUE is a counterfactual framework to assess whether alarms from runtime monitors enable useful interventions in robot policies.
The research question addresses the effectiveness of runtime failure monitors in robot policies, focusing on whether timely and necessary interventions can be made based on monitor alarms.
RESCUE introduces a counterfactual evaluation method that restores simulator and policy states to execution checkpoints, compares different actions, and determines if responding to alarms reduces the expected cost of task completion.
The authors report evaluations using OpenVLA-OFT and π₀.₅ on LIBERO-Spatial and LIBERO-Plus datasets with 128,340 counterfactual branches. They find that recoverability depends on both the state and the intervention, and that favorable detection scores do not always correlate with lower intervention costs.
About this brief
This article summarizes a public preprint abstract. Its findings have not been independently reproduced for this publication. Consult the paper for methods, evaluation scope and limitations. Automated briefs may contain errors; the original source takes precedence.