Close-Range Human Following Control on a Cane-Type Robot With Multi-Camera Fusion

• Published in: IEEE robotics and automation letters Vol. 8; no. 10; pp. 6443 - 6450
• Main Authors: Liu, Haowen, Wu, Fengxian, Zhong, Bin, Zhao, Yijun, Zhang, Jiatong, Niu, Wenxin, Zhang, Mingming
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.10.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Cameras; Cascade control; Controllers; Human detection and tracking; Legged locomotion; Microcomputers; Microcontrollers; Road conditions; Robot control; Robot dynamics; Robot kinematics; Robot vision systems; Robots; sensor fusion; sensor-based control; Tracking errors; Walking
• ISSN: 2377-3766; 2377-3766
• DOI: 10.1109/LRA.2023.3307011

Cane-type robots have been utilized to assist the mobility-impaired population. The essential technique for cane-type robots is to follow the user's ambulation at a close range. This study developed a new cane-type wheeled robot and proposed a novel human-following control frame with multi-camera fusion. This human following control adopts a cascade control strategy consisting of two parts: 1) a human following position controller that locates a user by detecting his/her legs' positions via multi-camera fusion and 2) a cane robot velocity controller to steer the cane robot to the target position. The proposed strategy's effectiveness has been validated in outdoor experiments with six healthy subjects. The experimental scenarios included different terrains (i.e., straight, turning, and inclined paths), road conditions (i.e., asphalt and brick roads) and walking speeds. The obtained results showed that the average tracking error in the X and Y directions was less than 4.1 and 4.4 cm, respectively, and the error in angle was less than 12.9<inline-formula><tex-math notation="LaTeX">^\circ</tex-math></inline-formula> across all scenarios. Moreover, the cane robot can effectively adapt to a wide range of individual gait patterns and achieve stable human following at daily walking speeds (0.74 m/s-1.47 m/s).