Jump to content

Open X-Embodiment

From PAI
Open X-Embodiment
A collaborative robotics data and model research initiative spanning data collected from multiple robot embodiments.
AreaPhysical AI and robotics
ApplicationsResearch, engineering and systems operation

Open X-Embodiment a collaborative robotics data and model research initiative spanning data collected from multiple robot embodiments. [1]

Motivation

Robotics training data is fragmented across laboratories, robot designs, sensors and tasks. Open X-Embodiment investigated whether combining heterogeneous experiences could support more transferable policies rather than models restricted to one laboratory setup.

Cross-embodiment data

A robot embodiment refers to its body, joints, sensors and action capabilities. Combining records from different embodiments requires attention to coordinate frames, action descriptions, observations, task labels and metadata quality. [2]

Models and findings

The project reported research on RT-X models built using multi-robot data. The project authors presented benefits of broader training data under their evaluations; results remain dependent on the particular datasets and test settings.

Limitations

Dataset contributions can differ in labeling, quality, usage permissions, safety assumptions and sampling. An open data collection is not a safety approval, and an experiment on one robot does not establish identical behavior on another.

See also

References

  1. ↑ “Scaling up learning across many different robot types”. Google DeepMind. Retrieved 2026-10-08.
  2. ↑ “RT-2: New model translates vision and language into action”. Google DeepMind. Retrieved 2026-10-08.


Further reading