VR Headset

VR 头显Common

A head-worn virtual/mixed-reality device, commonly used to teleoperate robots in embodied AI.

A VR headset is a head-worn device that displays imagery to both eyes and tracks head motion; most newer models also support see-through views of the real world (mixed reality, hence also called an XR or MR headset). In embodied AI, its main use is teleoperated data collection: the headset tracks the operator's head, wrist, and finger poses and maps them onto the robot's motion, while the video feed from cameras on the robot's head is streamed back to the headset in real time, letting the operator work as if standing in the robot's place. Compared with a leader-follower arm rig, a headset is cheaper, quicker to learn, and can also control a dexterous hand; common models include the Apple Vision Pro, Meta Quest 3, and PICO 4 Ultra.

ExampleOpen-TeleVision uses an Apple Vision Pro to track the operator's hands and streams the robot's stereo camera feed back to the headset in real time, teleoperating a humanoid robot through manipulation tasks.

Also called: XR Headset, MR Headset
Related: VR Teleoperation · Teleoperation · Apple Vision Pro · Meta Quest 3 / PICO 4 Ultra XR Headsets · Open-TeleVision · Motion Retargeting
Sources: Virtual reality headset - Wikipedia