Artificial vision support system (AVS2) for improved prosthetic vision

• Published in: Journal of medical engineering & technology Vol. 38; no. 8; pp. 385 - 395
• Main Authors: Fink, Wolfgang, Tarbell, Mark A.
• Format: Journal Article
• Language: English
• Published: England Informa UK Ltd 01.11.2014; Taylor & Francis
• Subjects: Artificial vision; Blindness - therapy; Humans; Image Processing, Computer-Assisted; Prostheses and Implants; real time image processing; retinal implant; smartphone; Telemetry; Vision, Ocular; Visual Perception; visual prosthesis; retinal implant; smartphone; visual prosthesis; Artificial vision; real time image processing
• ISSN: 0309-1902; 1464-522X; 1464-522X
• DOI: 10.3109/03091902.2014.957869

Abstract State-of-the-art and upcoming camera-driven, implanted artificial vision systems provide only tens to hundreds of electrodes, affording only limited visual perception for blind subjects. Therefore, real time image processing is crucial to enhance and optimize this limited perception. Since tens or hundreds of pixels/electrodes allow only for a very crude approximation of the typically megapixel optical resolution of the external camera image feed, the preservation and enhancement of contrast differences and transitions, such as edges, are especially important compared to picture details such as object texture. An Artificial Vision Support System (AVS2) is devised that displays the captured video stream in a pixelation conforming to the dimension of the epi-retinal implant electrode array. AVS2, using efficient image processing modules, modifies the captured video stream in real time, enhancing 'present but hidden' objects to overcome inadequacies or extremes in the camera imagery. As a result, visual prosthesis carriers may now be able to discern such objects in their 'field-of-view', thus enabling mobility in environments that would otherwise be too hazardous to navigate. The image processing modules can be engaged repeatedly in a user-defined order, which is a unique capability. AVS2 is directly applicable to any artificial vision system that is based on an imaging modality (video, infrared, sound, ultrasound, microwave, radar, etc.) as the first step in the stimulation/processing cascade, such as: retinal implants (i.e. epi-retinal, sub-retinal, suprachoroidal), optic nerve implants, cortical implants, electric tongue stimulators, or tactile stimulators.