Projects

Glovity: Wearable Teleoperation (CobotAI)

CobotAI wearable teleoperation product—hand-pose capture, mapping onto robot arms and dexterous hands, and multimodal demonstration recording.

Period · 2025.06 – nowongoing

The question is how a wearable stack can transfer hand intent and contact onto robot arms and dexterous hands, and keep those traces as training data. Glovity is CobotAI’s TeleX line: gloves and a neck-worn controller capture hand pose, map it onto arms and hands, and record multimodal demonstrations for later robot learning.

I lead product development of that stack—haptic gloves, spatial wrench feedback, and the TeleX-SDK—covering hand tracking, arm/hand mapping, and the data-collection pipeline. The system is used as an industrial embodied-AI capture terminal, including public demos such as InnoEX 2026.

The accompanying paper is with Yuyang Gao and Pai Zheng at The Hong Kong Polytechnic University. The hero video is a teleoperated gluing task; the clips below are the rest of the internal demos: pose capture, hand mapping, teleoperated collection, and first-person recording at an unfixed workstation.

Hand-pose capture on the glove.

Mapping onto a dexterous hand.

Teleoperated demonstration collection.

Egocentric demonstration recording.