Classification of mental tasks from EEG signals using extreme learning machine

In this paper, a recently developed machine learning algorithm referred to as Extreme Learning Machine (ELM) is used to classify five mental tasks from different subjects using electroencephalogram (EEG) signals available from a well-known database. Performance of ELM is compared in terms of training time and classification accuracy with a Backpropagation Neural Network (BPNN) classifier and also Support Vector Machines (SVMs). For SVMs, the comparisons have been made for both 1-against-1 and 1-against-all methods. Results show that ELM needs an order of magnitude less training time compared with SVMs and two orders of magnitude less compared with BPNN. The classification accuracy of ELM is similar to that of SVMs and BPNN. The study showed that smoothing of the classifiers' outputs can significantly improve their classification accuracies.     

A Novel Approach for Lie Detection Based on F-Score and Extreme Learning Machine

A new machine learning method referred to as F-score_ELM was proposed to classify the lying and truth-telling using the electroencephalogram (EEG) signals from 28 guilty and innocent subjects. Thirty-one features were extracted from the probe responses from these subjects. Then, a recently-developed classifier called extreme learning machine (ELM) was combined with F-score, a simple but effective feature selection method, to jointly optimize the number of the hidden nodes of ELM and the feature subset by a grid-searching training procedure. The method was compared to two classification models combining principal component analysis with back-propagation network and support vector machine classifiers. We thoroughly assessed the performance of these classification models including the training and testing time, sensitivity and specificity from the training and testing sets, as well as network size. The experimental results showed that the number of the hidden nodes can be effectively optimized by the proposed method. Also, F-score_ELM obtained the best classification accuracy and required the shortest training and testing time.     

A novel multistage deep belief network based extreme learning machine ensemble learning paradigm for credit risk assessment

To achieve high assessment accuracy for credit risk, a novel multistage deep belief network (DBN) based extreme learning machine (ELM) ensemble learning methodology is proposed. In the proposed methodology, three main stages, i.e., training subsets generation, individual classifiers training and final ensemble output, are involved. In the first stage, bagging sampling algorithm is applied to generate different training subsets for guaranteeing enough training data. Second, the ELM, an effective AI forecasting tool with the unique merits of time-saving and high accuracy, is utilized as the individual classifier, and diverse ensemble members can be accordingly formulated with different subsets and different initial conditions. In the final stage, the individual results are fused into final classification output via the DBN model with sufficient hidden layers, which can effectively capture the valuable information hidden in ensemble members. For illustration and verification, the experimental study on one publicly available credit risk dataset is conducted, and the results show the superiority of the proposed multistage DBN-based ELM ensemble learning paradigm in terms of high classification accuracy.     

Prediction of effluent quality in papermaking wastewater treatment processes using dynamic kernel-based extreme learning machine

Papermaking wastewater accounts for a large proportion of industrial wastewater, and it is essential to obtain accurate and reliable effluent indices in real-time. Considering the complexity, nonlinearity, and time variability of wastewater treatment processes, a dynamic kernel extreme learning machine (DKELM) method is proposed to predict the key quality indices of effluent chemical oxygen demand (COD). A time lag coefficient is introduced and a kernel function is embedded into the extreme learning machine (ELM) to extract dynamic information and obtain better prediction accuracy. A case study for modeling a wastewater treatment process is demonstrated to evaluate the performance of the proposed DKELM. The results illustrate that both training and prediction accuracy of the DKELM model is superior to other models. For the prediction of the quality indices of effluent COD, the determinate coefficient of the DKELM model is increased by 27.52 %, 21.36 %, 10.42 %, and 10.81 %, compared with partial least squares, ELM, dynamic ELM, and kernel ELM, respectively.     

Extreme Learning Machine-Based Classification of ADHD Using Brain Structural MRI Data

Background

Effective and accurate diagnosis of attention-deficit/hyperactivity disorder (ADHD) is currently of significant interest. ADHD has been associated with multiple cortical features from structural MRI data. However, most existing learning algorithms for ADHD identification contain obvious defects, such as time-consuming training, parameters selection, etc. The aims of this study were as follows: (1) Propose an ADHD classification model using the extreme learning machine (ELM) algorithm for automatic, efficient and objective clinical ADHD diagnosis. (2) Assess the computational efficiency and the effect of sample size on both ELM and support vector machine (SVM) methods and analyze which brain segments are involved in ADHD.

Methods

High-resolution three-dimensional MR images were acquired from 55 ADHD subjects and 55 healthy controls. Multiple brain measures (cortical thickness, etc.) were calculated using a fully automated procedure in the FreeSurfer software package. In total, 340 cortical features were automatically extracted from 68 brain segments with 5 basic cortical features. F-score and SFS methods were adopted to select the optimal features for ADHD classification. Both ELM and SVM were evaluated for classification accuracy using leave-one-out cross-validation.

Results

We achieved ADHD prediction accuracies of 90.18% for ELM using eleven combined features, 84.73% for SVM-Linear and 86.55% for SVM-RBF. Our results show that ELM has better computational efficiency and is more robust as sample size changes than is SVM for ADHD classification. The most pronounced differences between ADHD and healthy subjects were observed in the frontal lobe, temporal lobe, occipital lobe and insular.

Conclusion

Our ELM-based algorithm for ADHD diagnosis performs considerably better than the traditional SVM algorithm. This result suggests that ELM may be used for the clinical diagnosis of ADHD and the investigation of different brain diseases.     

Shaping the dynamics of a bidirectional neural interface

Progress in decoding neural signals has enabled the development of interfaces that translate cortical brain activities into commands for operating robotic arms and other devices. The electrical stimulation of sensory areas provides a means to create artificial sensory information about the state of a device. Taken together, neural activity recording and microstimulation techniques allow us to embed a portion of the central nervous system within a closed-loop system, whose behavior emerges from the combined dynamical properties of its neural and artificial components. In this study we asked if it is possible to concurrently regulate this bidirectional brain-machine interaction so as to shape a desired dynamical behavior of the combined system. To this end, we followed a well-known biological pathway. In vertebrates, the communications between brain and limb mechanics are mediated by the spinal cord, which combines brain instructions with sensory information and organizes coordinated patterns of muscle forces driving the limbs along dynamically stable trajectories. We report the creation and testing of the first neural interface that emulates this sensory-motor interaction. The interface organizes a bidirectional communication between sensory and motor areas of the brain of anaesthetized rats and an external dynamical object with programmable properties. The system includes (a) a motor interface decoding signals from a motor cortical area, and (b) a sensory interface encoding the state of the external object into electrical stimuli to a somatosensory area. The interactions between brain activities and the state of the external object generate a family of trajectories converging upon a selected equilibrium point from arbitrary starting locations. Thus, the bidirectional interface establishes the possibility to specify not only a particular movement trajectory but an entire family of motions, which includes the prescribed reactions to unexpected perturbations.     

Flexible Analytic Wavelet Transform Based Features for Physical Action Identification Using sEMG Signals

ObjectivesElectromyography (EMG) is recording of the electrical activity produced by skeletal muscles. The classification of the EMG signals for different physical actions can be useful in restoring some or all of the lost motor functionalities in these individuals. Accuracy in classifying the EMG signal indicates efficient control of prosthesis.Material and methodsThe flexible analytic wavelet transform (FAWT) is used for classification of surface electromyography (sEMG) signals for identification of physical actions. FAWT is an efficient method for decomposition of sEMG signal into eight sub-bands, features namely neg-entropy, mean absolute value (MAV), variance (VAR), modified mean absolute value type 1 (MAV1), waveform length (WL), simple square integral (SSI), Tsallis entropy, integrated EMG (IEMG) are extracted from the sub-bands. Extracted features are fed into an extreme learning machine (ELM) classifier with sigmoid activation function.ResultsComprehensive experiments are conducted on the input sEMG signals and the accuracy, sensitivity and specificity scores are used for performance measurement. Experiments showed that among all sub-bands, the seventh sub-band provided the best performance where the recorded accuracy, sensitivity and specificity values were 99.36%, 99.36% and 99.93%, respectively. The comparison results showed best efficiency of proposed method as compared to other methods on the same dataset.ConclusionThis paper investigates the usage of the FAWT and ELM on sEMG signal classification. The results show that the proposed method is quite efficient in classification of the sEMG signals. It is also observed that the seventh sub-band of the FAWT provides the best discrimination property. In the future works, recent wavelet transform methods will be used for improving the classification performance.     

Extreme learning machine classification method for lower limb movement recognition

In order to identify the lower limb movements accurately and quickly, a recognition method based on extreme learning machine (ELM) is proposed. The recognizing target set is constructed by decomposing the daily actions into different segments. To get the recognition accuracy of seven movements based on the surface electromyography, the recognition feature vector space is established by integrating short-time statistical characteristics under time domain, and locally linear embedding algorithm is used to reduce the computational complexity and improve robustness of algorithm. Compared with BP, the overall recognition accuracy for each subject in the best dimension with ELM is above 95%.     

Rule Extraction Based on Extreme Learning Machine and an Improved Ant-Miner Algorithm for Transient Stability Assessment

In order to overcome the problems of poor understandability of the pattern recognition-based transient stability assessment (PRTSA) methods, a new rule extraction method based on extreme learning machine (ELM) and an improved Ant-miner (IAM) algorithm is presented in this paper. First, the basic principles of ELM and Ant-miner algorithm are respectively introduced. Then, based on the selected optimal feature subset, an example sample set is generated by the trained ELM-based PRTSA model. And finally, a set of classification rules are obtained by IAM algorithm to replace the original ELM network. The novelty of this proposal is that transient stability rules are extracted from an example sample set generated by the trained ELM-based transient stability assessment model by using IAM algorithm. The effectiveness of the proposed method is shown by the application results on the New England 39-bus power system and a practical power system — the southern power system of Hebei province.     

Brain-Computer Interface Controlled Cyborg: Establishing a Functional Information Transfer Pathway from Human Brain to Cockroach Brain

An all-chain-wireless brain-to-brain system (BTBS), which enabled motion control of a cyborg cockroach via human brain, was developed in this work. Steady-state visual evoked potential (SSVEP) based brain-computer interface (BCI) was used in this system for recognizing human motion intention and an optimization algorithm was proposed in SSVEP to improve online performance of the BCI. The cyborg cockroach was developed by surgically integrating a portable microstimulator that could generate invasive electrical nerve stimulation. Through Bluetooth communication, specific electrical pulse trains could be triggered from the microstimulator by BCI commands and were sent through the antenna nerve to stimulate the brain of cockroach. Serial experiments were designed and conducted to test overall performance of the BTBS with six human subjects and three cockroaches. The experimental results showed that the online classification accuracy of three-mode BCI increased from 72.86% to 78.56% by 5.70% using the optimization algorithm and the mean response accuracy of the cyborgs using this system reached 89.5%. Moreover, the results also showed that the cyborg could be navigated by the human brain to complete walking along an S-shape track with the success rate of about 20%, suggesting the proposed BTBS established a feasible functional information transfer pathway from the human brain to the cockroach brain.     

Cardiovascular Disorder Severity Detection Using Myocardial Anatomic Features Based Optimized Extreme Learning Machine Approach

ObjectivesThis study focuses on integration of anatomical left ventricle myocardium features and optimized extreme learning machine (ELM) for discrimination of subjects with normal, mild, moderate and severe abnormal ejection fraction (EF). The physiological alterations in myocardium have diagnostic relevance to the etiology of cardiovascular diseases (CVD) with reduced EF.Materials and MethodsThis assessment is carried out on cardiovascular magnetic resonance (CMR) images of 104 subjects available in Kaggle Second Annual Data Science Bowl. The Segment CMR framework is used to segment myocardium from cardiac MR images, and it is subdivided into 16 sectors. 86 clinically significant anatomical features are extracted and subjected to ELM framework. Regularization coefficient and hidden neurons influence the prediction accuracy of ELM. The optimal value for these parameters is achieved with the butterfly optimizer (BO). A comparative study of BOELM framework with different activation functions and feature set has been conducted.ResultsAmong the individual feature set, myocardial volume at ED gives a better classification accuracy of 83.3% compared to others. Further, the given BOELM framework is able to provide higher multi-class accuracy of 95.2% with the entire feature set than ELM. Better discrimination of healthy and moderate abnormal subjects is achieved than other sub groups.ConclusionThe combined anatomical sector wise myocardial features assisted BOELM is able to predict the severity levels of CVDs. Thus, this study supports the radiologists in the mass diagnosis of cardiac disorder.     

Automatic Detection and Classification of Mammograms Using Improved Extreme Learning Machine with Deep Learning

Background and objectiveBreast cancer, the most intrusive form of cancer affecting women globally. Next to lung cancer, breast cancer is the one that provides a greater number of cancer deaths among women. In recent times, several intelligent methodologies were come into existence for building an effective detection and classification of such noxious type of cancer. For further improving the rate of early diagnosis and for increasing the life span of victims, optimistic light of research is essential in breast cancer classification. Accordingly, a new customized method of integrating the concept of deep learning with the extreme learning machine (ELM), which is optimized using a simple crow-search algorithm (ICS-ELM). Thus, to enhance the state-of-the-art workings, an improved deep feature-based crow-search optimized extreme learning machine is proposed for addressing the health-care problem. The paper pours a light-of-research on detecting the input mammograms as either normal or abnormal. Subsequently, it focuses on further classifying the type of abnormal severities i.e., benign type or malignant.Materials and methodsThe digital mammograms for this work are taken from the Curated Breast Imaging Subset of DDSM (CBIS-DDSM), Mammographic Image Analysis Society (MIAS), and INbreast datasets. Herein, the work employs 570 digital mammograms (250 normal, 200 benign and 120 malignant cases) from CBIS-DDSM dataset, 322 digital mammograms (207 normal, 64 benign and 51 malignant cases) from MIAS database and 179 full-field digital mammograms (66 normal, 56 benign and 57 malignant cases) from INbreast dataset for its evaluation. The work utilizes ResNet-18 based deep extracted features with proposed Improved Crow-Search Optimized Extreme Learning Machine (ICS-ELM) algorithm.ResultsThe proposed work is finally compared with the existing Support Vector Machines (RBF kernel), ELM, particle swarm optimization (PSO) optimized ELM, and crow-search optimized ELM, where the maximum overall classification accuracy is obtained for the proposed method with 97.193% for DDSM, 98.137% for MIAS and 98.266% for INbreast datasets, respectively.ConclusionThe obtained results reveal that the proposed Computer-Aided-Diagnosis (CAD) tool is robust for the automatic detection and classification of breast cancer.     

Multi-category classification using an Extreme Learning Machine for microarray gene expression cancer diagnosis

In this paper, the recently developed Extreme Learning Machine (ELM) is used for direct multicategory classification problems in the cancer diagnosis area. ELM avoids problems like local minima, improper learning rate and overfitting commonly faced by iterative learning methods and completes the training very fast. We have evaluated the multi-category classification performance of ELM on three benchmark microarray datasets for cancer diagnosis, namely, the GCM dataset, the Lung dataset and the Lymphoma dataset. The results indicate that ELM produces comparable or better classification accuracies with reduced training time and implementation complexity compared to artificial neural networks methods like conventional back-propagation ANN, Linder's SANN, and Support Vector Machine methods like SVM-OVO and Ramaswamy's SVM-OVA. ELM also achieves better accuracies for classification of individual categories.     

A novel algorithm with differential evolution and coral reef optimization for extreme learning machine training

Extreme learning machine (ELM) is a novel and fast learning method to train single layer feed-forward networks. However due to the demand for larger number of hidden neurons, the prediction speed of ELM is not fast enough. An evolutionary based ELM with differential evolution (DE) has been proposed to reduce the prediction time of original ELM. But it may still get stuck at local optima. In this paper, a novel algorithm hybridizing DE and metaheuristic coral reef optimization (CRO), which is called differential evolution coral reef optimization (DECRO), is proposed to balance the explorative power and exploitive power to reach better performance. The thought and the implement of DECRO algorithm are discussed in this article with detail. DE, CRO and DECRO are applied to ELM training respectively. Experimental results show that DECRO-ELM can reduce the prediction time of original ELM, and obtain better performance for training ELM than both DE and CRO.     

The forecast of the postoperative survival time of patients suffered from non-small cell lung cancer based on PCA and extreme learning machine

In this paper, a new effective model is proposed to forecast how long the postoperative patients suffered from non-small cell lung cancer will survive. The new effective model which is based on the extreme learning machine (ELM) and principal component analysis (PCA) can forecast successfully the postoperative patients' survival time. The new model obtains better prediction accuracy and faster convergence rate which the model using backpropagation (BP) algorithm and the Levenberg-Marquardt (LM) algorithm to forecast the postoperative patients' survival time can not achieve. Finally, simulation results are given to verify the efficiency and effectiveness of our proposed new model.     

High accuracy decoding of movement target direction in non-human primates based on common spatial patterns of local field potentials

Background

The current development of brain-machine interface technology is limited, among other factors, by concerns about the long-term stability of single- and multi-unit neural signals. In addition, the understanding of the relation between potentially more stable neural signals, such as local field potentials, and motor behavior is still in its early stages.

Methodology/Principal Findings

We tested the hypothesis that spatial correlation patterns of neural data can be used to decode movement target direction. In particular, we examined local field potentials (LFP), which are thought to be more stable over time than single unit activity (SUA). Using LFP recordings from chronically implanted electrodes in the dorsal premotor and primary motor cortex of non-human primates trained to make arm movements in different directions, we made the following observations: (i) it is possible to decode movement target direction with high fidelity from the spatial correlation patterns of neural activity in both primary motor (M1) and dorsal premotor cortex (PMd); (ii) the decoding accuracy of LFP was similar to the decoding accuracy obtained with the set of SUA recorded simultaneously; (iii) directional information varied with the LFP frequency sub-band, being greater in low (0.3–4 Hz) and high (48–200 Hz) frequency bands than in intermediate bands; (iv) the amount of directional information was similar in M1 and PMd; (v) reliable decoding was achieved well in advance of movement onset; and (vi) LFP were relatively stable over a period of one week.

Conclusions/Significance

The results demonstrate that the spatial correlation patterns of LFP signals can be used to decode movement target direction. This finding suggests that parameters of movement, such as target direction, have a stable spatial distribution within primary motor and dorsal premotor cortex, which may be used for brain-machine interfaces.     

Computer-assisted analysis of epiluminescence microscopy images of pigmented skin lesions.

BACKGROUND: Epiluminescence microscopy (ELM) is a noninvasive clinical tool recently developed for the diagnosis of pigmented skin lesions (PSLs), with the aim of improving melanoma screening strategies. However, the complexity of the ELM grading protocol means that considerable expertise is required for differential diagnosis. In this paper we propose a computer-based tool able to screen ELM images of PSLs in order to aid clinicians in the detection of lesion patterns useful for differential diagnosis. METHODS: The method proposed is based on the supervised classification of pixels of digitized ELM images, and leads to the construction of classes of pixels used for image segmentation. This process has two major phases, i.e., a learning phase, where several hundred pixels are used in order to train and validate a classification model, and an application step, which consists of a massive classification of billions of pixels (i.e., the full image) by means of the rules obtained in the first phase. RESULTS: Our results show that the proposed method is suitable for lesion-from-background extraction, for complete image segmentation into several typical diagnostic patterns, and for artifact rejection. Hence, our prototype has the potential to assist in distinguishing lesion patterns which are associated with diagnostic information such as diffuse pigmentation, dark globules (black dots and brown globules), and the gray-blue veil. CONCLUSIONS: The system proposed in this paper can be considered as a tool to assist in PSL diagnosis.     

Influence of Stimuli Spatial Proximity on a SSVEP-Based BCI Performance

Objective: Steady-State Visual Evoked Potentials based Brain-Computer Interfaces (SSVEP-based BCIs) systems have been shown as promising technology due to their short response time and ease of use. SSVEP-based BCIs use brain responses to a flickering visual stimulus as an input command to an external application or device, and it can be influenced by stimulus properties, signal recording, and signal processing. We aim to investigate the system performance varying the stimuli spatial proximity (a stimulus property).Material and methods: We performed a comparative analysis of two visual interface designs (named cross and square) for an SSVEP-based BCI. The power spectrum density (PSD) was used as feature extraction and the Support Machine Vector (SVM) as classification method. We also analyzed the effects of five flickering frequencies (6.67, 8.57, 10, 12 e 15 Hz) between and within interfaces.Results: We found higher accuracy rates for the flickering frequencies of 10, 12, and 15 Hz. The stimulus of 10 Hz presented the highest SSVEP amplitude response for both interfaces. The system presented the best performance (highest classification accuracy and information transfer rate) using the cross interface (lower visual angle).Conclusion: Our findings suggest that the system has the highest performance in the spatial proximity range from 4° to 13° (visual angle). In addition, we conclude that as the stimulus spatial proximity increases, the interference from other stimuli reduces, and the SSVEP amplitude response decreases, which reduces system accuracy. The inter-stimulus distance is a visual interface parameter that must be chosen carefully to increase the efficiency of an SSVEP-based BCI.     

Sensing with the motor cortex

The primary motor cortex is a critical node in the network of brain regions responsible for voluntary motor behavior. It has been less appreciated, however, that the motor cortex exhibits sensory responses in a variety of modalities including vision and somatosensation. We review current work that emphasizes the heterogeneity in sensorimotor responses in the motor cortex and focus on its implications for cortical control of movement as well as for brain-machine interface development.     

A Supplementary System for a Brain-Machine Interface Based on Jaw Artifacts for the Bidimensional Control of a Robotic Arm

Non-invasive Brain-Machine Interfaces (BMIs) are being used more and more these days to design systems focused on helping people with motor disabilities. Spontaneous BMIs translate user''s brain signals into commands to control devices. On these systems, by and large, 2 different mental tasks can be detected with enough accuracy. However, a large training time is required and the system needs to be adjusted on each session. This paper presents a supplementary system that employs BMI sensors, allowing the use of 2 systems (the BMI system and the supplementary system) with the same data acquisition device. This supplementary system is designed to control a robotic arm in two dimensions using electromyographical (EMG) signals extracted from the electroencephalographical (EEG) recordings. These signals are voluntarily produced by users clenching their jaws. EEG signals (with EMG contributions) were registered and analyzed to obtain the electrodes and the range of frequencies which provide the best classification results for 5 different clenching tasks. A training stage, based on the 2-dimensional control of a cursor, was designed and used by the volunteers to get used to this control. Afterwards, the control was extrapolated to a robotic arm in a 2-dimensional workspace. Although the training performed by volunteers requires 70 minutes, the final results suggest that in a shorter period of time (45 min), users should be able to control the robotic arm in 2 dimensions with their jaws. The designed system is compared with a similar 2-dimensional system based on spontaneous BMIs, and our system shows faster and more accurate performance. This is due to the nature of the control signals. Brain potentials are much more difficult to control than the electromyographical signals produced by jaw clenches. Additionally, the presented system also shows an improvement in the results compared with an electrooculographic system in a similar environment.