LIDAR Assist Spatial Sensing for the Visually Impaired and Performance Analysis

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 26; no. 9; pp. 1727 - 1734
• Main Authors: Ton, Carolyn, Omar, Abdelmalak, Szedenko, Vitaliy, Tran, Viet Hung, Aftab, Alina, Perla, Fabiana, Bernstein, Michael J., Yang, Yi
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.09.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Audio data; Barriers; Blind; Cameras; Depth perception; Detection; Ear; Echolocation; Frequency; Headphones; Horizontal orientation; Information processing; Laser radar; Lidar; Meters; navigation aid; neuroplasticity; Psychology; Sound; sound scape; Spatial data; Spatial databases; Training; Visual impairment
• ISSN: 1534-4320; 1558-0210; 1558-0210
• DOI: 10.1109/TNSRE.2018.2859800

Echolocation enables people with impaired or no vision to comprehend the surrounding spatial information through the reflected sound. However, this technique often requires substantial training, and the accuracy of echolocation is subject to various conditions. Furthermore, the individuals who practice this sensing method must simultaneously generate the sound and process the received audio information. This paper proposes and evaluates a proof-of-concept light detection and ranging (LIDAR) assist spatial sensing (LASS) system, which intends to overcome these restrictions by obtaining the spatial information of the user's surroundings through a LIDAR sensor and translating the spatial information into the stereo sound of various pitches. The stereo sound of relative pitch represents the information regarding objects' angular orientation and horizontal distance, respectively, thus granting visually impaired users an enhanced spatial perception of his or her surrounding areas and potential obstacles. This paper is divided into two phases: Phase I is to engineer the hardware and software of the LASS system and Phase II focuses on the system efficacy study. The study, approved by the Penn State Institutional Review Board, included 18 student volunteers, who were recruited through the Penn State Department of Psychology Subject Pool. This paper demonstrates that the blindfolded individuals equipped with the LASS system are able to quantitatively identify the surrounding obstacles, differentiate their relative distance, and distinguish the angular location of multiple objects with minimal training.