The speech neuroprosthesis

• Published in: Nature reviews. Neuroscience Vol. 25; no. 7; pp. 473 - 492
• Main Authors: Silva, Alexander B., Littlejohn, Kaylo T., Liu, Jessie R., Moses, David A., Chang, Edward F.
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 01.07.2024; Nature Publishing Group
• Subjects: 631/378; 631/378/2649; Algorithms; Animal Genetics and Genomics; Animals; Behavioral Sciences; Biological Techniques; Biomedical and Life Sciences; Biomedicine; Brain-Computer Interfaces; Clinical trials; Communication; Epilepsy; Humans; Interfaces; Neural coding; Neural Prostheses; Neurobiology; Neurosciences; Paralysis; Prosthetics; Review Article; Speech; Speech - physiology
• ISSN: 1471-003X; 1471-0048; 1471-0048; 1469-3178
• DOI: 10.1038/s41583-024-00819-9

Loss of speech after paralysis is devastating, but circumventing motor-pathway injury by directly decoding speech from intact cortical activity has the potential to restore natural communication and self-expression. Recent discoveries have defined how key features of speech production are facilitated by the coordinated activity of vocal-tract articulatory and motor-planning cortical representations. In this Review, we highlight such progress and how it has led to successful speech decoding, first in individuals implanted with intracranial electrodes for clinical epilepsy monitoring and subsequently in individuals with paralysis as part of early feasibility clinical trials to restore speech. We discuss high-spatiotemporal-resolution neural interfaces and the adaptation of state-of-the-art speech computational algorithms that have driven rapid and substantial progress in decoding neural activity into text, audible speech, and facial movements. Although restoring natural speech is a long-term goal, speech neuroprostheses already have performance levels that surpass communication rates offered by current assistive-communication technology. Given this accelerated rate of progress in the field, we propose key evaluation metrics for speed and accuracy, among others, to help standardize across studies. We finish by highlighting several directions to more fully explore the multidimensional feature space of speech and language, which will continue to accelerate progress towards a clinically viable speech neuroprosthesis. A clinically viable speech neuroprosthesis could restore natural speech to individuals with vocal-tract paralysis. In this Review, Silva et al. discuss rapid progress in neural interfaces and computational algorithms for decoding speech from cortical activity and propose evaluation metrics to help standardize speech neuroprostheses.