Computational models of association cortex

Recent computational models, or mathematical realizations of neurobiological theories, are providing insights into the organization and workings of the association cortex. Such models concern the construction of cortical maps, the neural basis of cognitive functions such as visual perception, reward-motivated learning and some aspects of consciousness.     

A unified multitask architecture for predicting local protein properties

A variety of functionally important protein properties, such as secondary structure, transmembrane topology and solvent accessibility, can be encoded as a labeling of amino acids. Indeed, the prediction of such properties from the primary amino acid sequence is one of the core projects of computational biology. Accordingly, a panoply of approaches have been developed for predicting such properties; however, most such approaches focus on solving a single task at a time. Motivated by recent, successful work in natural language processing, we propose to use multitask learning to train a single, joint model that exploits the dependencies among these various labeling tasks. We describe a deep neural network architecture that, given a protein sequence, outputs a host of predicted local properties, including secondary structure, solvent accessibility, transmembrane topology, signal peptides and DNA-binding residues. The network is trained jointly on all these tasks in a supervised fashion, augmented with a novel form of semi-supervised learning in which the model is trained to distinguish between local patterns from natural and synthetic protein sequences. The task-independent architecture of the network obviates the need for task-specific feature engineering. We demonstrate that, for all of the tasks that we considered, our approach leads to statistically significant improvements in performance, relative to a single task neural network approach, and that the resulting model achieves state-of-the-art performance.     

Asymmetric and adaptive reward coding via normalized reinforcement learning

Learning is widely modeled in psychology, neuroscience, and computer science by prediction error-guided reinforcement learning (RL) algorithms. While standard RL assumes linear reward functions, reward-related neural activity is a saturating, nonlinear function of reward; however, the computational and behavioral implications of nonlinear RL are unknown. Here, we show that nonlinear RL incorporating the canonical divisive normalization computation introduces an intrinsic and tunable asymmetry in prediction error coding. At the behavioral level, this asymmetry explains empirical variability in risk preferences typically attributed to asymmetric learning rates. At the neural level, diversity in asymmetries provides a computational mechanism for recently proposed theories of distributional RL, allowing the brain to learn the full probability distribution of future rewards. This behavioral and computational flexibility argues for an incorporation of biologically valid value functions in computational models of learning and decision-making.     

Multilevel structure in behaviour and in the brain: a model of Fuster's hierarchy

A basic question, intimately tied to the problem of action selection, is that of how actions are assembled into organized sequences. Theories of routine sequential behaviour have long acknowledged that it must rely not only on environmental cues but also on some internal representation of temporal or task context. It is assumed, in most theories, that such internal representations must be organized into a strict hierarchy, mirroring the hierarchical structure of naturalistic sequential behaviour. This article reviews an alternative computational account, which asserts that the representations underlying naturalistic sequential behaviour need not, and arguably cannot, assume a strictly hierarchical form. One apparent liability of this theory is that it seems to contradict neuroscientific evidence indicating that different levels of sequential structure in behaviour are represented at different levels in a hierarchy of cortical areas. New simulations, reported here, show not only that the original computational account can be reconciled with this alignment between behavioural and neural organization, but also that it gives rise to a novel explanation for how this alignment might develop through learning.     

Backward signal from medial temporal lobe in neural circuit reorganization of primate inferotemporal cortex

Neuropsychological theories proposed a critical role of the interaction between the medial temporal lobe and neocortex in the formation of long-term memory for facts and events, which has often been tested by learning of a series of paired words or figures in humans. We identify neural mechanisms of this long-term memory formation process by single-unit recording and molecular biological methods in an animal model of visual pair-association task in monkeys. In our previous studies, we found a group of neurons that manifested selective responses to both of the paired associates (pair-coding neuron) in the anterior inferior temporal (IT) cortex. It provides strong evidence that single IT neurons acquire the response-selectivity through associative learning, and suggests that the reorganized neural circuits for the pair-coding neurons serve as the memory engram of the pair-association learning. In this article, we investigated further mechanisms of the neural circuit reorganization. First, we tested the role of the backward connections from the medial temporal lobe to IT cortex. lbotenic acid was injected unilaterally into the entorhinal and perirhinal cortex which provided massive backward projections ipsilaterally to IT cortex. We found that the limbic lesion disrupted the associative code of the IT neurons between the paired associates, without impairing the visual response to each stimulus. Second, we ask why the limbic-neocortical interactions are so important. We hypothesize that limbic neurons would undergo rapid modification of synaptic connectivity and provide backward signals that guide reorganization of neocortical neural circuits. We then investigated the molecular basis of such rapid synaptic modifiability by detecting the expression of immediate-early genes. We found strong expression of zif268 during the learning of a new set of paired associates, most intensively in area 36 of the perirhinal cortex. All these results with visual pair-association task support our hypothesis, and demonstrate that the ‘consolidation’ process, which was first proposed on the basis of clinico-psychological evidence, can now be examined in the primate with neurophysiolocical and molecular biological approaches.     

Predicting enhancers with deep convolutional neural networks

Background

With the rapid development of deep sequencing techniques in the recent years, enhancers have been systematically identified in such projects as FANTOM and ENCODE, forming genome-wide landscapes in a series of human cell lines. Nevertheless, experimental approaches are still costly and time consuming for large scale identification of enhancers across a variety of tissues under different disease status, making computational identification of enhancers indispensable.

Results

To facilitate the identification of enhancers, we propose a computational framework, named DeepEnhancer, to distinguish enhancers from background genomic sequences. Our method purely relies on DNA sequences to predict enhancers in an end-to-end manner by using a deep convolutional neural network (CNN). We train our deep learning model on permissive enhancers and then adopt a transfer learning strategy to fine-tune the model on enhancers specific to a cell line. Results demonstrate the effectiveness and efficiency of our method in the classification of enhancers against random sequences, exhibiting advantages of deep learning over traditional sequence-based classifiers. We then construct a variety of neural networks with different architectures and show the usefulness of such techniques as max-pooling and batch normalization in our method. To gain the interpretability of our approach, we further visualize convolutional kernels as sequence logos and successfully identify similar motifs in the JASPAR database.

Conclusions

DeepEnhancer enables the identification of novel enhancers using only DNA sequences via a highly accurate deep learning model. The proposed computational framework can also be applied to similar problems, thereby prompting the use of machine learning methods in life sciences.

     

A computational mechanism for unified gain and timing control in the cerebellum

Precise gain and timing control is the goal of cerebellar motor learning. Because the basic neural circuitry of the cerebellum is homogeneous throughout the cerebellar cortex, a single computational mechanism may be used for simultaneous gain and timing control. Although many computational models of the cerebellum have been proposed for either gain or timing control, few models have aimed to unify them. In this paper, we hypothesize that gain and timing control can be unified by learning of the complete waveform of the desired movement profile instructed by climbing fiber signals. To justify our hypothesis, we adopted a large-scale spiking network model of the cerebellum, which was originally developed for cerebellar timing mechanisms to explain the experimental data of Pavlovian delay eyeblink conditioning, to the gain adaptation of optokinetic response (OKR) eye movements. By conducting large-scale computer simulations, we could reproduce some features of OKR adaptation, such as the learning-related change of simple spike firing of model Purkinje cells and vestibular nuclear neurons, simulated gain increase, and frequency-dependent gain increase. These results suggest that the cerebellum may use a single computational mechanism to control gain and timing simultaneously.     

Chapter 10: Mining Genome-Wide Genetic Markers

Genome-wide association study (GWAS) aims to discover genetic factors underlying phenotypic traits. The large number of genetic factors poses both computational and statistical challenges. Various computational approaches have been developed for large scale GWAS. In this chapter, we will discuss several widely used computational approaches in GWAS. The following topics will be covered: (1) An introduction to the background of GWAS. (2) The existing computational approaches that are widely used in GWAS. This will cover single-locus, epistasis detection, and machine learning methods that have been recently developed in biology, statistic, and computer science communities. This part will be the main focus of this chapter. (3) The limitations of current approaches and future directions.

What to Learn in This Chapter

• The background of Genome-wide association study (GWAS).
• The existing computational approaches that are widely used in GWAS. This will cover single-locus, epistasis detection, and machine learning methods.
• The limitations of current approaches and future directions.

This article is part of the “Translational Bioinformatics” collection for PLOS Computational Biology.

     

Embedding Responses in Spontaneous Neural Activity Shaped through Sequential Learning

Recent experimental measurements have demonstrated that spontaneous neural activity in the absence of explicit external stimuli has remarkable spatiotemporal structure. This spontaneous activity has also been shown to play a key role in the response to external stimuli. To better understand this role, we proposed a viewpoint, “memories-as-bifurcations,” that differs from the traditional “memories-as-attractors” viewpoint. Memory recall from the memories-as-bifurcations viewpoint occurs when the spontaneous neural activity is changed to an appropriate output activity upon application of an input, known as a bifurcation in dynamical systems theory, wherein the input modifies the flow structure of the neural dynamics. Learning, then, is a process that helps create neural dynamical systems such that a target output pattern is generated as an attractor upon a given input. Based on this novel viewpoint, we introduce in this paper an associative memory model with a sequential learning process. Using a simple Hebbian-type learning, the model is able to memorize a large number of input/output mappings. The neural dynamics shaped through the learning exhibit different bifurcations to make the requested targets stable upon an increase in the input, and the neural activity in the absence of input shows chaotic dynamics with occasional approaches to the memorized target patterns. These results suggest that these dynamics facilitate the bifurcations to each target attractor upon application of the corresponding input, which thus increases the capacity for learning. This theoretical finding about the behavior of the spontaneous neural activity is consistent with recent experimental observations in which the neural activity without stimuli wanders among patterns evoked by previously applied signals. In addition, the neural networks shaped by learning properly reflect the correlations of input and target-output patterns in a similar manner to those designed in our previous study.     

A computational framework for the study of confidence in humans and animals

Confidence judgements, self-assessments about the quality of a subject's knowledge, are considered a central example of metacognition. Prima facie, introspection and self-report appear the only way to access the subjective sense of confidence or uncertainty. Contrary to this notion, overt behavioural measures can be used to study confidence judgements by animals trained in decision-making tasks with perceptual or mnemonic uncertainty. Here, we suggest that a computational approach can clarify the issues involved in interpreting these tasks and provide a much needed springboard for advancing the scientific understanding of confidence. We first review relevant theories of probabilistic inference and decision-making. We then critically discuss behavioural tasks employed to measure confidence in animals and show how quantitative models can help to constrain the computational strategies underlying confidence-reporting behaviours. In our view, post-decision wagering tasks with continuous measures of confidence appear to offer the best available metrics of confidence. Since behavioural reports alone provide a limited window into mechanism, we argue that progress calls for measuring the neural representations and identifying the computations underlying confidence reports. We present a case study using such a computational approach to study the neural correlates of decision confidence in rats. This work shows that confidence assessments may be considered higher order, but can be generated using elementary neural computations that are available to a wide range of species. Finally, we discuss the relationship of confidence judgements to the wider behavioural uses of confidence and uncertainty.     

Unsupervised neural learning on lie group

The present paper aims at introducing the concepts and mathematical details of unsupervised neural learning with orthonormality constrains. The neural structures considered are single non-linear layers and the learnable parameters are organized in matrices, as usual, which gives the parameters spaces the geometrical structure of the Euclidean manifold. The constraint of orthonormality for the connection-matrices further restricts the parameters spaces to differential manifolds such as the orthogonal group, the compact Stiefel manifold and its extensions. For these reasons, the instruments for characterizing and studying the behavior of learning equations for these particular networks are provided by the differential geometry of Lie groups. In particular, two sub-classes of the general Lie-group learning theories are studied in detail, dealing with first-order (gradient-based) and second-order (non-gradient-based) learning. Although the considered class of learning theories is very general, in the present paper special attention is paid to unsupervised learning paradigms.     

Automated analysis of high‐content microscopy data with deep learning

Existing computational pipelines for quantitative analysis of high‐content microscopy data rely on traditional machine learning approaches that fail to accurately classify more than a single dataset without substantial tuning and training, requiring extensive analysis. Here, we demonstrate that the application of deep learning to biological image data can overcome the pitfalls associated with conventional machine learning classifiers. Using a deep convolutional neural network (DeepLoc) to analyze yeast cell images, we show improved performance over traditional approaches in the automated classification of protein subcellular localization. We also demonstrate the ability of DeepLoc to classify highly divergent image sets, including images of pheromone‐arrested cells with abnormal cellular morphology, as well as images generated in different genetic backgrounds and in different laboratories. We offer an open‐source implementation that enables updating DeepLoc on new microscopy datasets. This study highlights deep learning as an important tool for the expedited analysis of high‐content microscopy data.     

Learning Pitch with STDP: A Computational Model of Place and Temporal Pitch Perception Using Spiking Neural Networks

Pitch perception is important for understanding speech prosody, music perception, recognizing tones in tonal languages, and perceiving speech in noisy environments. The two principal pitch perception theories consider the place of maximum neural excitation along the auditory nerve and the temporal pattern of the auditory neurons’ action potentials (spikes) as pitch cues. This paper describes a biophysical mechanism by which fine-structure temporal information can be extracted from the spikes generated at the auditory periphery. Deriving meaningful pitch-related information from spike times requires neural structures specialized in capturing synchronous or correlated activity from amongst neural events. The emergence of such pitch-processing neural mechanisms is described through a computational model of auditory processing. Simulation results show that a correlation-based, unsupervised, spike-based form of Hebbian learning can explain the development of neural structures required for recognizing the pitch of simple and complex tones, with or without the fundamental frequency. The temporal code is robust to variations in the spectral shape of the signal and thus can explain the phenomenon of pitch constancy.     

The engram formation and the global oscillations of CA3

The investigation on the conditions which cause global population oscillatory activities in neural fields, originated some years ago with reference to a kinetic theory of neural systems, as been further deepened in this paper. In particular, the genesis of sharp waves and of some rhythmic activities, such as theta and gamma rhythms, of the hippocampal CA3 field, behaviorally important for their links to learning and memory, has been analyzed with more details. To this aim, the modeling-computational framework previously devised for the study of activities in large neural fields, has been enhanced in such a way that a greater number of biological features, extended dendritic trees—in particular, could be taken into account. By using that methodology, a two-dimensional model of the entire CA3 field has been described and its activity, as it results from the several external inputs impinging on it, has been simulated. As a consequence of these investigations, some hypotheses have been elaborated about the possible function of global oscillatory activities of neural populations of Hippocampus in the engram formation.     

Animal learning and intelligence

The ability to learn is common to most animal species: the need to exploit past experience being obviously extremely important for survival, many animals have evolved ways of coping with it. Although the complexity of learning needed for optimal survival may be different in different species, the basic mechanisms appear to be fairly constant even in phylogenetically distant ones. This homogeneity across species in learning mechanisms is in some ways surprising in view of the large phylogenetic differences and of the considerable variability not only in the general plan of their bodily structures, but also, more specifically, in their neural organization and in their behavioral adaptations. One possible explanation is that animals have acquired learning very precociously, and that the original and basic mechanisms have proved so efficient and faultproof as to be preserved from then on without any significant modification. Most researchers of the subject seem to accept the equation «intelligence=learning capability», operationally very useful because it leads to a variety of formal tests. Some researchers, stressing that behavior is subject to the same evolutionary principles as any other character of the organism and acknowledging some problems in the accepted laws of learning, have tried to find a satisfactory answer to the question of animal intelligence by attempting a synthesis between the concepts of animal learning psychology and those of ethology. To some extent, dissatisfaction with established learning theories originated within the theories themselves: the study of phenomena such as autoshaping, selective attention, preferential learning of some responses amongst the many possible, conditioned learning of taste aversions, etc. Further difficulties for conditioning theories arose from the discovery of ethological phenomena. Other researchers have attempted to check the hypothesis that animals possess cognition. A number of complex experimental situtations have been devised to this purpose, but the results still are far from conclusive.     

Neuromodulation: selected approaches and challenges

The brain operates through complex interactions in the flow of information and signal processing within neural networks. The ‘wiring’ of such networks, being neuronal or glial, can physically and/or functionally go rogue in various pathological states. Neuromodulation, as a multidisciplinary venture, attempts to correct such faulty nets. In this review, selected approaches and challenges in neuromodulation are discussed. The use of water‐dispersible carbon nanotubes has been proven effective in the modulation of neurite outgrowth in culture and in aiding regeneration after spinal cord injury in vivo. Studying neural circuits using computational biology and analytical engineering approaches brings to light geometrical mapping of dynamics within neural networks, much needed information for stimulation interventions in medical practice. Indeed, sophisticated desynchronization approaches used for brain stimulation have been successful in coaxing ‘misfiring’ neuronal circuits to resume productive firing patterns in various human disorders. Devices have been developed for the real‐time measurement of various neurotransmitters as well as electrical activity in the human brain during electrical deep brain stimulation. Such devices can establish the dynamics of electrochemical changes in the brain during stimulation. With increasing application of nanomaterials in devices for electrical and chemical recording and stimulating in the brain, the era of cellular, and even intracellular, precision neuromodulation will soon be upon us.     

Computational Models to Synthesize Human Walking

The synthesis of human walking is of great interest in biomechanics and biomimetic engineering due to its predictive capabilities and potential applications in clinical biomechanics, rehabilitation engineering and biomimetic robotics. In this paper, the various methods that have been used to synthesize humanwalking are reviewed from an engineering viewpoint. This involves a wide spectrum of approaches, from simple passive walking theories to large-scale computational models integrating the nervous, muscular and skeletal systems. These methods are roughly categorized under four headings： models inspired by the concept of a CPG （Central Pattern Generator）, methods based on the principles of control engineering, predictive gait simulation using optimisation, and models inspired by passive walking theory. The shortcomings and advantages of these methods are examined, and future directions are discussed in the context of providing insights into the neural control objectives driving gait and improving the stability of the predicted gaits. Future advancements are likely to be motivated by improved understanding of neural control strategies and the subtle complexities of the musculoskeletal system during human locomotion. It is only a matter of time before predictive gait models become a practical and valuable tool in clinical diagnosis, rehabilitation engineering and robotics.