XBot-Omni: An Omni-Modal Model for Embodied Understanding and Interaction
Automatically prepared brief
XBot-Omni is a Thinker--Talker--Actor architecture designed for embodied interaction, integrating multimodal perception and expression in robots.
The research question focuses on how to enable robots to effectively communicate their intentions using multimodal interactions, including speech, body motion, and facial expressions.
The proposed approach introduces XBot-Omni, which extends the Omni paradigm to include robotic-specific modalities like body motion and facial expressions. It consists of a Thinker for processing various inputs, a Talker for generating speech, and an Actor for coordinating bodily expressions.
The authors report comprehensive evaluations across seven benchmarks, showing strong multimodal understanding and high-quality motion generation capabilities in both general and robot-centric contexts.
About this brief
This article summarizes a public preprint abstract. Its findings have not been independently reproduced for this publication. Consult the paper for methods, evaluation scope and limitations. Automated briefs may contain errors; the original source takes precedence.