Adding LiDAR to wrist-mounted robot interfaces makes data collection more robust in real-world conditions, letting robots learn complex tasks like deformable object manipulation that were previously impossible with vision alone.
UMI-3D improves robot data collection by adding LiDAR to the Universal Manipulation Interface, replacing unreliable monocular vision with 3D spatial sensing. This enables robots to learn manipulation tasks in cluttered, dynamic environments where the original vision-only system failed, while keeping the system portable and affordable.