The research aims to enhance the robustness of Vision-Language-Action (VLA) models by addressing their vulnerability to unanticipated failures during distribution shifts, which can lead to equipment damage or safety risks.
The authors propose VLA-Tug, a lightweight probing technique applied to the latent layers of VLA models. This approach aims to improve early failure detection and control false alarms and missed detections with minimal computational overhead.
The authors report that VLA-Tug enhances early failure detection by up to 30% compared to the best learned baseline while maintaining low false-positive rates. It also maintains valid bounds on missed-detection and false-alarm rates in up to 86% of runs under unseen tasks, compared to at most 21% for baselines. Additionally, VLA-Tug predicts failure modes to enable corrective actions, increasing top-3 accuracy on unseen tasks by up to 44%.