The research question focuses on how to enable robots to effectively communicate their intentions using multimodal interactions, including speech, body motion, and facial expressions.

The proposed approach introduces XBot-Omni, which extends the Omni paradigm to include robotic-specific modalities like body motion and facial expressions. It consists of a Thinker for processing various inputs, a Talker for generating speech, and an Actor for coordinating bodily expressions.

The authors report comprehensive evaluations across seven benchmarks, showing strong multimodal understanding and high-quality motion generation capabilities in both general and robot-centric contexts.