EEG-MEG Integration Enhances the Characterization of Functional and Effective Connectivity in the Resting State Network

At the sensor level many aspects, such as spectral power, functional and effective connectivity as well as relative-power-ratio ratio (RPR) and spatial resolution have been comprehensively investigated through both electroencephalography (EEG) and magnetoencephalography (MEG). Despite this, differences between both modalities have not yet been systematically studied by direct comparison. It remains an open question as to whether the integration of EEG and MEG data would improve the information obtained from the above mentioned parameters. Here, EEG (64-channel system) and MEG (275 sensor system) were recorded simultaneously in conditions with eyes open (EO) and eyes closed (EC) in 29 healthy adults. Spectral power, functional and effective connectivity, RPR, and spatial resolution were analyzed at five different frequency bands (delta, theta, alpha, beta and gamma). Networks of functional and effective connectivity were described using a spatial filter approach called the dynamic imaging of coherent sources (DICS) followed by the renormalized partial directed coherence (RPDC). Absolute mean power at the sensor level was significantly higher in EEG than in MEG data in both EO and EC conditions. At the source level, there was a trend towards a better performance of the combined EEG+MEG analysis compared with separate EEG or MEG analyses for the source mean power, functional correlation, effective connectivity for both EO and EC. The network of coherent sources and the spatial resolution were similar for both the EEG and MEG data if they were analyzed separately. Results indicate that the combined approach has several advantages over the separate analyses of both EEG and MEG. Moreover, by a direct comparison of EEG and MEG, EEG was characterized by significantly higher values in all measured parameters in both sensor and source level. All the above conclusions are specific to the resting state task and the specific analysis used in this study to have general conclusion multi-center studies would be helpful.     

Relevant EEG features for the classification of spontaneous motor-related tasks

 There is a growing interest in the use of physiological signals for communication and operation of devices for the severely motor disabled as well as for healthy people. A few groups around the world have developed brain-computer interfaces (BCIs) that rely upon the recognition of motor-related tasks (i.e., imagination of movements) from on-line EEG signals. In this paper we seek to find and analyze the set of relevant EEG features that best differentiate spontaneous motor-related mental tasks from each other. This study empirically demonstrates the benefits of heuristic feature selection methods for EEG-based classification of mental tasks. In particular, it is shown that the classifier performance improves for all the considered subjects with only a small proportion of features. Thus, the use of just those relevant features increases the efficiency of the brain interfaces and, most importantly, enables a greater level of adaptation of the personal BCI to the individual user. Received: 15 January 2001 / Accepted in revised form: 19 July 2001     

Nonnegative tensor factorization for continuous EEG classification

In this paper we present a method for continuous EEG classification, where we employ nonnegative tensor factorization (NTF) to determine discriminative spectral features and use the Viterbi algorithm to continuously classify multiple mental tasks. This is an extension of our previous work on the use of nonnegative matrix factorization (NMF) for EEG classification. Numerical experiments with two data sets in BCI competition, confirm the useful behavior of the method for continuous EEG classification.     

Brain-computer interface based on generation of visual images

This paper examines the task of recognizing EEG patterns that correspond to performing three mental tasks: relaxation and imagining of two types of pictures: faces and houses. The experiments were performed using two EEG headsets: BrainProducts ActiCap and Emotiv EPOC. The Emotiv headset becomes widely used in consumer BCI application allowing for conducting large-scale EEG experiments in the future. Since classification accuracy significantly exceeded the level of random classification during the first three days of the experiment with EPOC headset, a control experiment was performed on the fourth day using ActiCap. The control experiment has shown that utilization of high-quality research equipment can enhance classification accuracy (up to 68% in some subjects) and that the accuracy is independent of the presence of EEG artifacts related to blinking and eye movement. This study also shows that computationally-inexpensive bayesian classifier based on covariance matrix analysis yields similar classification accuracy in this problem as a more sophisticated Multi-class Common Spatial Patterns (MCSP) classifier.     

Regularized logistic regression and multiobjective variable selection for classifying MEG data

This paper addresses the question of maximizing classifier accuracy for classifying task-related mental activity from Magnetoencelophalography (MEG) data. We propose the use of different sources of information and introduce an automatic channel selection procedure. To determine an informative set of channels, our approach combines a variety of machine learning algorithms: feature subset selection methods, classifiers based on regularized logistic regression, information fusion, and multiobjective optimization based on probabilistic modeling of the search space. The experimental results show that our proposal is able to improve classification accuracy compared to approaches whose classifiers use only one type of MEG information or for which the set of channels is fixed a priori.     

Accounting for Linear Transformations of EEG and MEG Data in Source Analysis

Analyses of electro- and magnetoencephalography (EEG, MEG) data often involve a linear modification of signals at the sensor level. Examples include re-referencing of the EEG, computation of synthetic gradiometer in MEG, or the removal of artifactual independent components to clean EEG and MEG data. A question of practical relevance is, if such modifications must be accounted for by adapting the physical forward model (leadfield) before subsequent source analysis. Here, we show that two scenarios need to be differentiated. In the first scenario, which corresponds to re-referencing the EEG and synthetic gradiometer computation in MEG, the leadfield must be adapted before source analysis. In the second scenario, which corresponds to removing artifactual components to ‘clean’ the data, the leadfield must not be changed. We demonstrate and discuss the consequences of wrongly modifying the leadfield in the latter case for an example. Future EEG and MEG studies employing source analyses should carefully consider whether and, if so, how the leadfield must be modified as explicated here.     

Development of a variational scheme for model inversion of multi-area model of brain. Part I: simulation evaluation

We previously developed an integrated model of the brain within a single cortical area for functional Magnetic Resonance Imaging (fMRI), electroencephalography (EEG), and magnetoencephalography (MEG) using an extended neural mass model (ENMM). We then extended ENMM from a single-area to a multi-area model to develop a neural mass model of the entire brain. To this end, we derived a nonlinear state-space representation of the multi-area model. In Parts I and II of these two companion papers (henceforth called Part I and Part II), we develop and evaluate a variational Bayesian expectation maximization (VBEM) method to estimate parameters of multi-area ENMM (MEN) using E/MEG data. In Part I, we derive a state-space representation of MEN and use VBEM method for model inversion (parameter estimation). We evaluate and validate performance of VBEM method for model inversion of MEN using simulation studies in various signal-to-noise ratios. Details of VBEM method are presented in Part II. The proposed approach provides a useful technique for analyzing effective connectivity using non-invasive EEG and MEG methods.     

Classifying Response Correctness across Different Task Sets: A Machine Learning Approach

Erroneous behavior usually elicits a distinct pattern in neural waveforms. In particular, inspection of the concurrent recorded electroencephalograms (EEG) typically reveals a negative potential at fronto-central electrodes shortly following a response error (Ne or ERN) as well as an error-awareness-related positivity (Pe). Seemingly, the brain signal contains information about the occurrence of an error. Assuming a general error evaluation system, the question arises whether this information can be utilized in order to classify behavioral performance within or even across different cognitive tasks. In the present study, a machine learning approach was employed to investigate the outlined issue. Ne as well as Pe were extracted from the single-trial EEG signals of participants conducting a flanker and a mental rotation task and subjected to a machine learning classification scheme (via a support vector machine, SVM). Overall, individual performance in the flanker task was classified more accurately, with accuracy rates of above 85%. Most importantly, it was even feasible to classify responses across both tasks. In particular, an SVM trained on the flanker task could identify erroneous behavior with almost 70% accuracy in the EEG data recorded during the rotation task, and vice versa. Summed up, we replicate that the response-related EEG signal can be used to identify erroneous behavior within a particular task. Going beyond this, it was possible to classify response types across functionally different tasks. Therefore, the outlined methodological approach appears promising with respect to future applications.     

A Neural Network-Based Optimal Spatial Filter Design Method for Motor Imagery Classification

In this study, a novel spatial filter design method is introduced. Spatial filtering is an important processing step for feature extraction in motor imagery-based brain-computer interfaces. This paper introduces a new motor imagery signal classification method combined with spatial filter optimization. We simultaneously train the spatial filter and the classifier using a neural network approach. The proposed spatial filter network (SFN) is composed of two layers: a spatial filtering layer and a classifier layer. These two layers are linked to each other with non-linear mapping functions. The proposed method addresses two shortcomings of the common spatial patterns (CSP) algorithm. First, CSP aims to maximize the between-classes variance while ignoring the minimization of within-classes variances. Consequently, the features obtained using the CSP method may have large within-classes variances. Second, the maximizing optimization function of CSP increases the classification accuracy indirectly because an independent classifier is used after the CSP method. With SFN, we aimed to maximize the between-classes variance while minimizing within-classes variances and simultaneously optimizing the spatial filter and the classifier. To classify motor imagery EEG signals, we modified the well-known feed-forward structure and derived forward and backward equations that correspond to the proposed structure. We tested our algorithm on simple toy data. Then, we compared the SFN with conventional CSP and its multi-class version, called one-versus-rest CSP, on two data sets from BCI competition III. The evaluation results demonstrate that SFN is a good alternative for classifying motor imagery EEG signals with increased classification accuracy.     

Modelling and detecting deep brain activity with MEG and EEG

We introduce an anatomical and electrophysiological model of deep brain structures dedicated to magnetoencephalography (MEG) and electroencephalography (EEG) source imaging. So far, most imaging inverse models considered that MEG/EEG surface signals were predominantly produced by cortical, hence superficial, neural currents. Here we question whether crucial deep brain structures such as the basal ganglia and the hippocampus may also contribute to distant, scalp MEG and EEG measurements. We first design a realistic anatomical and electrophysiological model of these structures and subsequently run Monte-Carlo experiments to evaluate the respective sensitivity of the MEG and EEG to signals from deeper origins. Results indicate that MEG/EEG may indeed localize these deeper generators, which is confirmed here from experimental MEG data reporting on the modulation of alpha (10–12 Hz) brain waves.     

Individually Adapted Imagery Improves Brain-Computer Interface Performance in End-Users with Disability

Brain-computer interfaces (BCIs) translate oscillatory electroencephalogram (EEG) patterns into action. Different mental activities modulate spontaneous EEG rhythms in various ways. Non-stationarity and inherent variability of EEG signals, however, make reliable recognition of modulated EEG patterns challenging. Able-bodied individuals who use a BCI for the first time achieve - on average - binary classification performance of about 75%. Performance in users with central nervous system (CNS) tissue damage is typically lower. User training generally enhances reliability of EEG pattern generation and thus also robustness of pattern recognition. In this study, we investigated the impact of mental tasks on binary classification performance in BCI users with central nervous system (CNS) tissue damage such as persons with stroke or spinal cord injury (SCI). Motor imagery (MI), that is the kinesthetic imagination of movement (e.g. squeezing a rubber ball with the right hand), is the "gold standard" and mainly used to modulate EEG patterns. Based on our recent results in able-bodied users, we hypothesized that pair-wise combination of "brain-teaser" (e.g. mental subtraction and mental word association) and "dynamic imagery" (e.g. hand and feet MI) tasks significantly increases classification performance of induced EEG patterns in the selected end-user group. Within-day (How stable is the classification within a day?) and between-day (How well does a model trained on day one perform on unseen data of day two?) analysis of variability of mental task pair classification in nine individuals confirmed the hypothesis. We found that the use of the classical MI task pair hand vs. feed leads to significantly lower classification accuracy - in average up to 15% less - in most users with stroke or SCI. User-specific selection of task pairs was again essential to enhance performance. We expect that the gained evidence will significantly contribute to make imagery-based BCI technology become accessible to a larger population of users including individuals with special needs due to CNS damage.     

不同思维作业电信号的高准确度模式分类

本文采用独立分量(ICA)分析对不同思维作业的脑电(EEG)信号进行预处理,再用自回归(AR)参数模型提取EEG信号特征,最后利用BP网络完成对特征样本集的训练和分类。实验结果表明,所采用的方法提高了脑电思维模式作业的准确度,对两种到五种不同思维作业未经训练的数据的平均分类准确度达到79％以上,超过现有文献报道的结果。     

A review of EEG and MEG for brainnetome research

The majority of brain activities are performed by functionally integrating separate regions of the brain. Therefore, the synchronous operation of the brain’s multiple regions or neuronal assemblies can be represented as a network with nodes that are interconnected by links. Because of the complexity of brain interactions and their varying effects at different levels of complexity, one of the corresponding authors of this paper recently proposed the brainnetome as a new –ome to explore and integrate the brain network at different scales. Because electroencephalography (EEG) and magnetoencephalography (MEG) are noninvasive and have outstanding temporal resolution and because they are the primary clinical techniques used to capture the dynamics of neuronal connections, they lend themselves to the analysis of the neural networks comprising the brainnetome. Because of EEG/MEG’s applicability to brainnetome analyses, the aim of this review is to identify the procedures that can be used to form a network using EEG/MEG data in sensor or source space and to promote EEG/MEG network analysis for either neuroscience or clinical applications. To accomplish this aim, we show the relationship of the brainnetome to brain networks at the macroscale and provide a systematic review of network construction using EEG and MEG. Some potential applications of the EEG/MEG brainnetome are to use newly developed methods to associate the properties of a brainnetome with indices of cognition or disease conditions. Associations based on EEG/MEG brainnetome analysis may improve the comprehension of the functioning of the brain in neuroscience research or the recognition of abnormal patterns in neurological disease.     

Comparative power spectral analysis of simultaneous elecroencephalographic and magnetoencephalographic recordings in humans suggests non-resistive extracellular media

The resistive or non-resistive nature of the extracellular space in the brain is still debated, and is an important issue for correctly modeling extracellular potentials. Here, we first show theoretically that if the medium is resistive, the frequency scaling should be the same for electroencephalogram (EEG) and magnetoencephalogram (MEG) signals at low frequencies (<10 Hz). To test this prediction, we analyzed the spectrum of simultaneous EEG and MEG measurements in four human subjects. The frequency scaling of EEG displays coherent variations across the brain, in general between 1/f and 1/f ², and tends to be smaller in parietal/temporal regions. In a given region, although the variability of the frequency scaling exponent was higher for MEG compared to EEG, both signals consistently scale with a different exponent. In some cases, the scaling was similar, but only when the signal-to-noise ratio of the MEG was low. Several methods of noise correction for environmental and instrumental noise were tested, and they all increased the difference between EEG and MEG scaling. In conclusion, there is a significant difference in frequency scaling between EEG and MEG, which can be explained if the extracellular medium (including other layers such as dura matter and skull) is globally non-resistive.     

Electro/magnetoencephalography beamforming with spatial restrictions based on sparsity

We present a source localization method for electroencephalographic (EEG) and magnetoencephalographic (MEG) data which is based on an estimate of the sparsity obtained through the eigencanceler (EIG), which is a spatial filter whose weights are constrained to lie in the noise subspace. The EIG provides rejection of directional interferences while minimizing noise contributions and maintaining specified beam pattern constraints. In our case, the EIG is used to estimate the sparsity of the signal as a function of the position, then we use this information to spatially restrict the neural sources to locations out of the sparsity maxima. As proof of the concept, we incorporate this restriction in the “classical” linearly constrained minimum variance (LCMV) source localization approach in order to enhance its performance. We present numerical examples to evaluate the proposed method using realistically simulated EEG/MEG data for different signal-to-noise (SNR) conditions and various levels of correlation between sources, as well as real EEG/MEG measurements of median nerve stimulation. Our results show that the proposed method has the potential of reducing the bias on the search of neural sources in the classical approach, as well as making it more effective in localizing correlated sources.     

Application of recurrence quantification analysis for the automated identification of epileptic EEG signals

Epilepsy is a common neurological disorder that is characterized by the recurrence of seizures. Electroencephalogram (EEG) signals are widely used to diagnose seizures. Because of the non-linear and dynamic nature of the EEG signals, it is difficult to effectively decipher the subtle changes in these signals by visual inspection and by using linear techniques. Therefore, non-linear methods are being researched to analyze the EEG signals. In this work, we use the recorded EEG signals in Recurrence Plots (RP), and extract Recurrence Quantification Analysis (RQA) parameters from the RP in order to classify the EEG signals into normal, ictal, and interictal classes. Recurrence Plot (RP) is a graph that shows all the times at which a state of the dynamical system recurs. Studies have reported significantly different RQA parameters for the three classes. However, more studies are needed to develop classifiers that use these promising features and present good classification accuracy in differentiating the three types of EEG segments. Therefore, in this work, we have used ten RQA parameters to quantify the important features in the EEG signals.These features were fed to seven different classifiers: Support vector machine (SVM), Gaussian Mixture Model (GMM), Fuzzy Sugeno Classifier, K-Nearest Neighbor (KNN), Naive Bayes Classifier (NBC), Decision Tree (DT), and Radial Basis Probabilistic Neural Network (RBPNN). Our results show that the SVM classifier was able to identify the EEG class with an average efficiency of 95.6%, sensitivity and specificity of 98.9% and 97.8%, respectively.     

Mapping informative clusters in a hierarchical [corrected] framework of FMRI multivariate analysis

Pattern recognition methods have become increasingly popular in fMRI data analysis, which are powerful in discriminating between multi-voxel patterns of brain activities associated with different mental states. However, when they are used in functional brain mapping, the location of discriminative voxels varies significantly, raising difficulties in interpreting the locus of the effect. Here we proposed a hierarchical framework of multivariate approach that maps informative clusters rather than voxels to achieve reliable functional brain mapping without compromising the discriminative power. In particular, we first searched for local homogeneous clusters that consisted of voxels with similar response profiles. Then, a multi-voxel classifier was built for each cluster to extract discriminative information from the multi-voxel patterns. Finally, through multivariate ranking, outputs from the classifiers were served as a multi-cluster pattern to identify informative clusters by examining interactions among clusters. Results from both simulated and real fMRI data demonstrated that this hierarchical approach showed better performance in the robustness of functional brain mapping than traditional voxel-based multivariate methods. In addition, the mapped clusters were highly overlapped for two perceptually equivalent object categories, further confirming the validity of our approach. In short, the hierarchical framework of multivariate approach is suitable for both pattern classification and brain mapping in fMRI studies.     

Decoding Speech Perception by Native and Non-Native Speakers Using Single-Trial Electrophysiological Data

Brain-computer interfaces (BCIs) are systems that use real-time analysis of neuroimaging data to determine the mental state of their user for purposes such as providing neurofeedback. Here, we investigate the feasibility of a BCI based on speech perception. Multivariate pattern classification methods were applied to single-trial EEG data collected during speech perception by native and non-native speakers. Two principal questions were asked: 1) Can differences in the perceived categories of pairs of phonemes be decoded at the single-trial level? 2) Can these same categorical differences be decoded across participants, within or between native-language groups? Results indicated that classification performance progressively increased with respect to the categorical status (within, boundary or across) of the stimulus contrast, and was also influenced by the native language of individual participants. Classifier performance showed strong relationships with traditional event-related potential measures and behavioral responses. The results of the cross-participant analysis indicated an overall increase in average classifier performance when trained on data from all participants (native and non-native). A second cross-participant classifier trained only on data from native speakers led to an overall improvement in performance for native speakers, but a reduction in performance for non-native speakers. We also found that the native language of a given participant could be decoded on the basis of EEG data with accuracy above 80%. These results indicate that electrophysiological responses underlying speech perception can be decoded at the single-trial level, and that decoding performance systematically reflects graded changes in the responses related to the phonological status of the stimuli. This approach could be used in extensions of the BCI paradigm to support perceptual learning during second language acquisition.     

Mapping Informative Clusters in a Hierarchial Framework of fMRI Multivariate Analysis

Pattern recognition methods have become increasingly popular in fMRI data analysis, which are powerful in discriminating between multi-voxel patterns of brain activities associated with different mental states. However, when they are used in functional brain mapping, the location of discriminative voxels varies significantly, raising difficulties in interpreting the locus of the effect. Here we proposed a hierarchical framework of multivariate approach that maps informative clusters rather than voxels to achieve reliable functional brain mapping without compromising the discriminative power. In particular, we first searched for local homogeneous clusters that consisted of voxels with similar response profiles. Then, a multi-voxel classifier was built for each cluster to extract discriminative information from the multi-voxel patterns. Finally, through multivariate ranking, outputs from the classifiers were served as a multi-cluster pattern to identify informative clusters by examining interactions among clusters. Results from both simulated and real fMRI data demonstrated that this hierarchical approach showed better performance in the robustness of functional brain mapping than traditional voxel-based multivariate methods. In addition, the mapped clusters were highly overlapped for two perceptually equivalent object categories, further confirming the validity of our approach. In short, the hierarchical framework of multivariate approach is suitable for both pattern classification and brain mapping in fMRI studies.     

Effects of Spatial Pattern Scale of Brain Activity on the Sensitivity of DOT,fMRI, EEG and MEG

The objective of this work is to quantify how patterns of cortical activity at different spatial scales are measured by noninvasive functional neuroimaging sensors. We simulated cortical activation patterns at nine different spatial scales in a realistic head model and propagated this activity to magnetoencephalography (MEG), electroencephalography (EEG), diffuse optical tomography (DOT), and functional magnetic resonance imaging (fMRI) sensors in arrangements that are typically used in functional neuroimaging studies. We estimated contrast transfer functions (CTF), correlation distances in sensor space, and the minimum resolvable spatial scale of cortical activity for each modality. We found that CTF decreases as the spatial extent of cortical activity decreases, and that correlations between nearby sensors depend on the spatial extent of cortical activity. For cortical activity on the intermediate spatial scale of 6.7 cm², the correlation distances (r>0.5) were 1.0 cm for fMRI, 2.0 cm for DOT, 12.8 for EEG, 9.5 cm for MEG magnetometers and 9.7 cm for MEG gradiometers. The resolvable spatial pattern scale was found to be 1.43 cm² for MEG magnetometers, 0.88 cm² for MEG gradiometers, 376 cm² for EEG, 0.75 cm² for DOT, and 0.072 cm² for fMRI. These findings show that sensitivity to cortical activity varies substantially as a function of spatial scale within and between the different imaging modalities. This information should be taken into account when interpreting neuroimaging data and when choosing the number of nodes for network analyses in sensor space.