Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inference
Automatically prepared brief
This research explores the importance of spatial information in vision-language-action (VLA) pruning strategies for robotic tasks, proposing a method called GeoScaffold that maintains spatial structures while reducing token usage.
The study addresses the limitation of existing VLA pruning strategies, which focus on task-level semantic relevance without considering the spatial information crucial for robotic manipulation. The authors construct a Stride baseline that uniformly samples tokens, demonstrating that while it can outperform semantic and random pruning at some levels, it fails when the number of tokens is significantly reduced.
To tackle this issue, the authors propose GeoScaffold, a training-free method that divides images into spatial regions, allocates token budgets based on task relevance, and selects key tokens within each region using farthest point sampling to minimize local coverage gaps.
The authors report that GeoScaffold retains only 20% of visual tokens while maintaining a high success rate and achieving faster prefill speeds compared to unpruned models on pi 0.5 and LIBERO datasets.
About this brief
This article summarizes a public preprint abstract. Its findings have not been independently reproduced for this publication. Consult the paper for methods, evaluation scope and limitations. Automated briefs may contain errors; the original source takes precedence.