Consistency and similarity of MEG- and fMRI-signal time courses during movie viewing

• Published in: NeuroImage (Orlando, Fla.) Vol. 173; pp. 361 - 369
• Main Authors: Lankinen, Kaisu, Saari, Jukka, Hlushchuk, Yevhen, Tikka, Pia, Parkkonen, Lauri, Hari, Riitta, Koskinen, Miika
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.06.2018; Elsevier Limited
• Subjects: Adult; Between-subjects design; Brain; Brain - physiology; Brain mapping; Brain Mapping - methods; Canonical correlation analysis; Cognition; Correlation analysis; EEG; Electroencephalography; Envelopes; Experiments; Female; Functional magnetic resonance imaging; Humans; Image Processing, Computer-Assisted - methods; Intersubject correlation; Magnetic Resonance Imaging; Magnetoencephalography; Male; Medical imaging; Middle Aged; Motion Pictures; Movie; Multivariate analysis; Naturalistic stimulation; Neuroimaging; Photic Stimulation; Signal Processing, Computer-Assisted; Spatial discrimination; Time series; Visual Perception - physiology; Young Adult; Functional magnetic resonance imaging; Movie; Naturalistic stimulation; Magnetoencephalography; Intersubject correlation; Canonical correlation analysis
• ISSN: 1053-8119; 1095-9572; 1095-9572
• DOI: 10.1016/j.neuroimage.2018.02.045

Movie viewing allows human perception and cognition to be studied in complex, real-life-like situations in a brain-imaging laboratory. Previous studies with functional magnetic resonance imaging (fMRI) and with magneto- and electroencephalography (MEG and EEG) have demonstrated consistent temporal dynamics of brain activity across movie viewers. However, little is known about the similarities and differences of fMRI and MEG or EEG dynamics during such naturalistic situations. We thus compared MEG and fMRI responses to the same 15-min black-and-white movie in the same eight subjects who watched the movie twice during both MEG and fMRI recordings. We analyzed intra- and intersubject voxel-wise correlations within each imaging modality as well as the correlation of the MEG envelopes and fMRI signals. The fMRI signals showed voxel-wise within- and between-subjects correlations up to r = 0.66 and r = 0.37, respectively, whereas these correlations were clearly weaker for the envelopes of band-pass filtered (7 frequency bands below 100 Hz) MEG signals (within-subjects correlation r < 0.14 and between-subjects r < 0.05). Direct MEG–fMRI voxel-wise correlations were unreliable. Notably, applying a spatial-filtering approach to the MEG data uncovered consistent canonical variates that showed considerably stronger (up to r = 0.25) between-subjects correlations than the univariate voxel-wise analysis. Furthermore, the envelopes of the time courses of these variates up to about 10 Hz showed association with fMRI signals in a general linear model. Similarities between envelopes of MEG canonical variates and fMRI voxel time-courses were seen mostly in occipital, but also in temporal and frontal brain regions, whereas intra- and intersubject correlations for MEG and fMRI separately were strongest only in the occipital areas. In contrast to the conventional univariate analysis, the spatial-filtering approach was able to uncover associations between the MEG envelopes and fMRI time courses, shedding light on the similarities of hemodynamic and electromagnetic brain activities during movie viewing.