Deep-Learning-Based Multivariate Pattern Analysis (dMVPA): A Tutorial and a Toolbox

• Published in: Frontiers in human neuroscience Vol. 15; p. 638052
• Main Authors: Kuntzelman, Karl M., Williams, Jacob M., Lim, Phui Cheng, Samal, Ashok, Rao, Prahalada K., Johnson, Matthew R.
• Format: Journal Article
• Language: English
• Published: Switzerland Frontiers Research Foundation 02.03.2021; Frontiers Media S.A
• Subjects: Cognitive ability; cognitive neuroscience; Datasets; Deep learning; EEG; Electroencephalography; fMRI; Functional magnetic resonance imaging; Image processing; Learning algorithms; Machine learning; Medical imaging; Nervous system; Neural networks; Neuroimaging; Neuroscience; Neurosciences; Noise; Software; deep learning; fMRI; EEG; neural networks; cognitive neuroscience; machine learning; MVPA; Python
• ISSN: 1662-5161; 1662-5161
• DOI: 10.3389/fnhum.2021.638052

In recent years, multivariate pattern analysis (MVPA) has been hugely beneficial for cognitive neuroscience by making new experiment designs possible and by increasing the inferential power of functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and other neuroimaging methodologies. In a similar time frame, “deep learning” (a term for the use of artificial neural networks with convolutional, recurrent, or similarly sophisticated architectures) has produced a parallel revolution in the field of machine learning and has been employed across a wide variety of applications. Traditional MVPA also uses a form of machine learning, but most commonly with much simpler techniques based on linear calculations; a number of studies have applied deep learning techniques to neuroimaging data, but we believe that those have barely scratched the surface of the potential deep learning holds for the field. In this paper, we provide a brief introduction to deep learning for those new to the technique, explore the logistical pros and cons of using deep learning to analyze neuroimaging data – which we term “deep MVPA,” or dMVPA – and introduce a new software toolbox (the “Deep Learning In Neuroimaging: Exploration, Analysis, Tools, and Education” package, DeLINEATE for short) intended to facilitate dMVPA for neuroscientists (and indeed, scientists more broadly) everywhere.