Similarity of fMRI Activity Patterns in Left Perirhinal Cortex Reflects Semantic Similarity between Words

• Published in: The Journal of neuroscience Vol. 33; no. 47; pp. 18597 - 18607
• Main Authors: Bruffaerts, Rose, Dupont, Patrick, Peeters, Ronald, De Deyne, Simon, Storms, Gerrit, Vandenberghe, Rik
• Format: Journal Article
• Language: English
• Published: United States Society for Neuroscience 20.11.2013
• Subjects: Adult; Analysis of Variance; Brain Mapping; Discrimination (Psychology); Female; Functional Laterality - physiology; Humans; Image Processing, Computer-Assisted; Magnetic Resonance Imaging; Male; Occipital Lobe - blood supply; Oxygen - blood; Photic Stimulation; Semantics; Temporal Lobe - blood supply; Vocabulary; Young Adult
• ISSN: 0270-6474; 1529-2401; 1529-2401
• DOI: 10.1523/JNEUROSCI.1548-13.2013

How verbal and nonverbal visuoperceptual input connects to semantic knowledge is a core question in visual and cognitive neuroscience, with significant clinical ramifications. In an event-related functional magnetic resonance imaging (fMRI) experiment we determined how cosine similarity between fMRI response patterns to concrete words and pictures reflects semantic clustering and semantic distances between the represented entities within a single category. Semantic clustering and semantic distances between 24 animate entities were derived from a concept-feature matrix based on feature generation by >1000 subjects. In the main fMRI study, 19 human subjects performed a property verification task with written words and pictures and a low-level control task. The univariate contrast between the semantic and the control task yielded extensive bilateral occipitotemporal activation from posterior cingulate to anteromedial temporal cortex. Entities belonging to a same semantic cluster elicited more similar fMRI activity patterns in left occipitotemporal cortex. When words and pictures were analyzed separately, the effect reached significance only for words. The semantic similarity effect for words was localized to left perirhinal cortex. According to a representational similarity analysis of left perirhinal responses, semantic distances between entities correlated inversely with cosine similarities between fMRI response patterns to written words. An independent replication study in 16 novel subjects confirmed these novel findings. Semantic similarity is reflected by similarity of functional topography at a fine-grained level in left perirhinal cortex. The word specificity excludes perceptually driven confounds as an explanation and is likely to be task dependent.