Brain Decoding of Multiple Subjects for Estimating Visual Information Based on a Probabilistic Generative Model

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 16; p. 6148
• Main Authors: Higashi, Takaaki, Maeda, Keisuke, Ogawa, Takahiro, Haseyama, Miki
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 17.08.2022; MDPI
• Subjects: Accuracy; Algorithms; Brain; brain decoding; functional magnetic resonance imaging (fMRI); generative model; Methods; multiple subjects; Normal distribution; Probability distribution; visual features; Visual perception; Germany
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22166148

Brain decoding is a process of decoding human cognitive contents from brain activities. However, improving the accuracy of brain decoding remains difficult due to the unique characteristics of the brain, such as the small sample size and high dimensionality of brain activities. Therefore, this paper proposes a method that effectively uses multi-subject brain activities to improve brain decoding accuracy. Specifically, we distinguish between the shared information common to multi-subject brain activities and the individual information based on each subject’s brain activities, and both types of information are used to decode human visual cognition. Both types of information are extracted as features belonging to a latent space using a probabilistic generative model. In the experiment, an publicly available dataset and five subjects were used, and the estimation accuracy was validated on the basis of a confidence score ranging from 0 to 1, and a large value indicates superiority. The proposed method achieved a confidence score of 0.867 for the best subject and an average of 0.813 for the five subjects, which was the best compared to other methods. The experimental results show that the proposed method can accurately decode visual cognition compared with other existing methods in which the shared information is not distinguished from the individual information.