Testing simulation theory with cross-modal multivariate classification of fMRI data

The discovery of mirror neurons has suggested a potential neural basis for simulation and common coding theories of action perception, theories which propose that we understand other people's actions because perceiving their actions activates some of our neurons in much the same way as when we perform the actions. We propose testing this model directly in humans with functional magnetic resonance imaging (fMRI) by means of cross-modal classification. Cross-modal classification evaluates whether a classifier that has learned to separate stimuli in the sensory domain can also separate the stimuli in the motor domain. Successful classification provides support for simulation theories because it means that the fMRI signal, and presumably brain activity, is similar when perceiving and performing actions. In this paper we demonstrate the feasibility of the technique by showing that classifiers which have learned to discriminate whether a participant heard a hand or a mouth action, based on the activity patterns in the premotor cortex, can also determine, without additional training, whether the participant executed a hand or mouth action. This provides direct evidence that, while perceiving others' actions, (1) the pattern of activity in premotor voxels with sensory properties is a significant source of information regarding the nature of these actions, and (2) that this information shares a common code with motor execution.     

Expectations and outcomes: decision-making in the primate brain

Success in a constantly changing environment requires that decision-making strategies be updated as reward contingencies change. How this is accomplished by the nervous system has, until recently, remained a profound mystery. New studies coupling economic theory with neurophysiological techniques have revealed the explicit representation of behavioral value. Specifically, when fluid reinforcement is paired with visually-guided eye movements, neurons in parietal cortex, prefrontal cortex, the basal ganglia, and superior colliculus—all nodes in a network linking visual stimulation with the generation of oculomotor behavior—encode the expected value of targets lying within their response fields. Other brain areas have been implicated in the processing of reward-related information in the abstract: midbrain dopaminergic neurons, for instance, signal an error in reward prediction. Still other brain areas link information about reward to the selection and performance of specific actions in order for behavior to adapt to changing environmental exigencies. Neurons in posterior cingulate cortex have been shown to carry signals related to both reward outcomes and oculomotor behavior, suggesting that they participate in updating estimates of orienting value.     

How (and why) the visual control of action differs from visual perception

Vision not only provides us with detailed knowledge of the world beyond our bodies, but it also guides our actions with respect to objects and events in that world. The computations required for vision-for-perception are quite different from those required for vision-for-action. The former uses relational metrics and scene-based frames of reference while the latter uses absolute metrics and effector-based frames of reference. These competing demands on vision have shaped the organization of the visual pathways in the primate brain, particularly within the visual areas of the cerebral cortex. The ventral ‘perceptual’ stream, projecting from early visual areas to inferior temporal cortex, helps to construct the rich and detailed visual representations of the world that allow us to identify objects and events, attach meaning and significance to them and establish their causal relations. By contrast, the dorsal ‘action’ stream, projecting from early visual areas to the posterior parietal cortex, plays a critical role in the real-time control of action, transforming information about the location and disposition of goal objects into the coordinate frames of the effectors being used to perform the action. The idea of two visual systems in a single brain might seem initially counterintuitive. Our visual experience of the world is so compelling that it is hard to believe that some other quite independent visual signal—one that we are unaware of—is guiding our movements. But evidence from a broad range of studies from neuropsychology to neuroimaging has shown that the visual signals that give us our experience of objects and events in the world are not the same ones that control our actions.     

Conditional control transfer mechanisms in the neocortex: 1. The basic model

A neural network model of the neocortex is developed which is derived from behavioural, neuroanatomical and neurophysiological findings. It is an attempt to provide a structural and functional account of the groundplan of the mammalian cerebral neocortex.Starting from the observation that the comparatively uniformly structured cortex is believed to be responsible for a wide range of behavioural tasks it is argued that all these tasks involve the integrated processing of two classes of information. The first of these, termed context information, concerns the current state of the world while the second, termed control information, concerns the animals goals, intentions and objectives. It is noted that this information dichotomy is a characteristic of all powerful information processing systems. In a digital computer the integration of the two types of information is accomplished by conditional jump instructions while in a linear control system it is accomplished by servomechanisms. Both of these may be regarded as examples of what are termed conditional control transfer devices. It is then postulated that the fundamental unit of neocortex is a conditional control transfer device.A simple neural element is then developed which has the properties of a conditional control transfer device. A number of examples are given to show how “programs” of behaviour may be built up from such units and computer simulations of these are described.In the discussion the computational power of the model is compared with that of other models of cortex and with current psychological findings regarding the role of central processes in perception.     

Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action

We show that while a primate chooses between two reaching actions, its motor system first represents both options and later reflects selection between them. When two potential targets appeared, many (43%) task-related, directionally tuned cells in dorsal premotor cortex (PMd) discharged if one of the targets was near their preferred direction. At the population level, this generated two simultaneous sustained directional signals corresponding to the current reach options. After a subsequent nonspatial cue identified the correct target, the corresponding directional signal increased, and the signal for the rejected target was suppressed. The PMd population reliably predicted the monkey's response choice, including errors. This supports a planning model in which multiple reach options are initially specified and then gradually eliminated in a competition for overt execution, as more information accumulates.     

What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience

Both developmental and neurophysiological research suggest a common coding between perceived and generated actions. This shared representational network is innately wired in humans. We review psychological evidence concerning the imitative behaviour of newborn human infants. We suggest that the mechanisms involved in infant imitation provide the foundation for understanding that others are 'like me' and underlie the development of theory of mind and empathy for others. We also analyse functional neuroimaging studies that explore the neurophysiological substrate of imitation in adults. We marshal evidence that imitation recruits not only shared neural representations between the self and the other but also cortical regions in the parietal cortex that are crucial for distinguishing between the perspective of self and other. Imitation is doubly revealing: it is used by infants to learn about adults, and by scientists to understand the organization and functioning of the brain.     

A competitive integration model of exogenous and endogenous eye movements

We present a model of the eye movement system in which the programming of an eye movement is the result of the competitive integration of information in the superior colliculi (SC). This brain area receives input from occipital cortex, the frontal eye fields, and the dorsolateral prefrontal cortex, on the basis of which it computes the location of the next saccadic target. Two critical assumptions in the model are that cortical inputs are not only excitatory, but can also inhibit saccades to specific locations, and that the SC continue to influence the trajectory of a saccade while it is being executed. With these assumptions, we account for many neurophysiological and behavioral findings from eye movement research. Interactions within the saccade map are shown to account for effects of distractors on saccadic reaction time (SRT) and saccade trajectory, including the global effect and oculomotor capture. In addition, the model accounts for express saccades, the gap effect, saccadic reaction times for antisaccades, and recorded responses from neurons in the SC and frontal eye fields in these tasks.     

Does phylogenetic relatedness influence the strength of competition among vascular plants?

A widely assumed but largely untested hypothesis central to ecology and evolutionary biology has been Charles Darwin's suggestion that closely related species will be more ecologically similar, and thus will compete more strongly with each other than they will with more distantly related species. We provide one of the first direct tests of the “competition-relatedness hypothesis” by combining two data sets: the relative competitive ability of 50 vascular plant species competing against 92 competitor species measured in five multi-species experiments, and measures of the phylogenetic relatedness of these species. In contrast to Darwin's assertion, there were weak relationships between the strength of competition and phylogenetic relatedness. Across all species studied, the competition-relatedness relationship was weak and not significant. This overall lack of pattern masked different responses of monocot and eudicot focal (phytometer) species. When monocots served as the focal (phytometer) species, the intensity of competition increased with the phylogenetic distance separating species, while competition decreased with phylogenetic distance for eudicot phytometers. These results were driven by the monocot-eudicot evolutionary split, such that monocots were poor competitors against eudicots, while eudicots are most strongly suppressed by other eudicots. There was no relationship between relatedness and competition for eudicots competing with other eudicots, while monocots did compete more intensely with closely related monocots than with distantly related monocots. Overall, the relationships between competition intensity and relatedness were weak compared to the strong and consistent relationships between competitive ability and functional traits such as plant size that have been reported by other studies. We suggest that Darwin's assertion that competition will be strongest among closely related species is not supported by empirical data, at least for the 142 vascular plant species in this study.     

Size and density mediate transitions between competition and facilitation

Species simultaneously compete with and facilitate one another. Size can mediate transitions along this competition–facilitation continuum, but the consequences for demography are unclear. We orthogonally manipulated the size of a focal species, and the size and density of a heterospecific neighbour, in the field using a model marine system. We then parameterised a size‐structured population model with our experimental data. We found that heterospecific size and density interactively altered the population dynamics of the focal species. Size determined whether heterospecifics facilitated (when small) or competed with (when large) the focal species, while density strengthened these interactions. Such size‐mediated interactions also altered the pace of the focal’s life history. We provide the first demonstration that size and density mediate competition and facilitation from a population dynamical perspective. We suspect such effects are ubiquitous, but currently underappreciated. We reiterate classic cautions against inferences about competitive hierarchies made in the absence of size‐specific data.     

Creating abstract topographic representations: Implications for coding,learning and reasoning

Topographic maps are a fundamental and ubiquitous feature of the sensory and motor regions of the brain. There is less evidence for the existence of conventional topographic maps in associational areas of the brain such as the prefrontal cortex and parietal cortex. The existence of topographically arranged anatomical projections is far more widespread and occurs in associational regions of the brain as well as sensory and motor regions: this points to a more widespread existence of topographically organised maps within associational cortex than currently recognised. Indeed, there is increasing evidence that abstract topographic representations may also occur in these regions. For example, a topographic mnemonic map of visual space has been described in the dorsolateral prefrontal cortex and topographically arranged visuospatial attentional signals have been described in parietal association cortex. This article explores how abstract representations might be extracted from sensory topographic representations and subsequently code abstract information. Finally a simple model is presented that shows how abstract topographic representations could be integrated with other information within the brain to solve problems or form abstract associations. The model uses correlative firing to detect associations between different types of stimuli. It is flexible because it can produce correlations between information represented in a topographic or non-topographic coordinate system. It is proposed that a similar process could be used in high-level cognitive operations such as learning and reasoning.     

Memory trace in prefrontal cortex: theory for the cognitive switch

The dorsolateral prefrontal cortex in human and non-human primates functions as the highest-order executor for the perception-action cycle. According to this view, when perceptual stimuli from the environment are novel or complex, the dorsolateral prefrontal cortex serves to set consciously a goal-directed scheme which broadly determines an action repertory to meet the particular demand from the environment. In this respect, the dorsolateral prefrontal cortex is a short-term activation device with the properties of a cognitive switch', because it couples a particular set of perceptual stimuli to a particular set of actions. Here, I suggest that, in order for the organism to react systematically to the environment, neural traces for the switch function must be stored in the brain. Thus, the highest-order, perception-action interface function of the dorsolateral prefrontal cortex per se depends on permanently stored neural traces in the dorsolateral prefrontal cortex and related structures. Such a memory system may be located functionally between two of the well-documented memory systems in the brain: the declarative memory system and the procedural memory system. Finally, based on available neurophysiological data, the possible mechanisms underlying the formation of cognitive switch traces are proposed.     

Mathematical Model for Two Germline Stem Cells Competing for Niche Occupancy

In the Drosophila germline stem cell ovary niche, two stem cells compete with each other for niche occupancy to maintain stem cell quality by ensuring that differentiated stem cells are rapidly pushed out the niche and replenished by normal ones (Jin et al. in Cell Stem Cell 2:39–49, 2008). To gain a deeper understanding of this biological phenomenon, we have derived a mathematical model for explaining the physical interactions between two stem cells. The model is a system of two nonlinear first order and one second order differential equations coupled with E-cadherins expression levels. The model can explain the dynamics of the competition process of two germline stem cells and may help to reveal missing information obtained from experimental results. The model predicts several qualitative features in the competition process, which may help to design rational experiments for a better understanding of the stem cell competition process.     

Interspecific Resource Competition Effects on Fisheries Revenue

In many fisheries multiple species are simultaneously caught while stock assessments and fishing quota are defined at species level. Yet species caught together often share habitat and resources, resulting in interspecific resource competition. The consequences of resource competition on population dynamics and revenue of simultaneously harvested species has received little attention due to the historical single stock approach in fisheries management. Here we present the results of a modelling study on the interaction between resource competition of sole (Solea solea) and slaice (Pleuronectus platessa) and simultaneous harvesting of these species, using a stage-structured population model. Three resources were included of which one is shared with a varied competition intensity. We find that plaice is the better competitor of the two species and adult plaice are more abundant than adult sole. When competition is high sole population biomass increases with increasing fishing effort prior to plaice extinction. As a result of this increase in the sole population, the revenue of the stocks combined as function of effort becomes bimodal with increasing resource competition. When considering a single stock quota for sole, its recovery with increasing effort may result in even more fishing effort that would drive the plaice population to extinction. When sole and plaice compete for resources the highest revenue is obtained at effort levels at which plaice is extinct. Ignoring resource competition promotes overfishing due to increasing stock of one species prior to extinction of the other species. Consequently, efforts to mitigate the decline in one species will not be effective if increased stock in the other species leads to increased quota. If a species is to be protected against extinction, management should not only be directed at this one species, but all species that compete with it for resource as well.     

Converging levels of analysis in the cognitive neuroscience of visual attention.

Experiments using behavioural, lesion, functional imaging and single neuron methods are considered in the context of a neuropsychological model of visual attention. According to this model, inputs compete for representation in multiple visually responsive brain systems, sensory and motor, cortical and subcortical. Competition is biased by advance priming of neurons responsive to current behavioural targets. Across systems competition is integrated such that the same, selected object tends to become dominant throughout. The behavioural studies reviewed concern divided attention within and between modalities. They implicate within-modality competition as one main restriction on concurrent stimulus identification. In contrast to the conventional association of lateral attentional focus with parietal lobe function, the lesion studies show attentional bias to be a widespread consequence of unilateral cortical damage. Although the clinical syndrome of unilateral neglect may indeed be associated with parietal lesions, this probably reflects an assortment of further deficits accompanying a simple attentional imbalance. The functional imaging studies show joint involvement of lateral prefrontal and occipital cortex in lateral attentional focus and competition. The single unit studies suggest how competition in several regions of extrastriate cortex is biased by advance priming of neurons responsive to current behavioural targets. Together, the concepts of competition, priming and integration allow a unified theoretical approach to findings from behavioural to single neuron levels.     

A Bayesian Model of Category-Specific Emotional Brain Responses

Understanding emotion is critical for a science of healthy and disordered brain function, but the neurophysiological basis of emotional experience is still poorly understood. We analyzed human brain activity patterns from 148 studies of emotion categories (2159 total participants) using a novel hierarchical Bayesian model. The model allowed us to classify which of five categories—fear, anger, disgust, sadness, or happiness—is engaged by a study with 66% accuracy (43-86% across categories). Analyses of the activity patterns encoded in the model revealed that each emotion category is associated with unique, prototypical patterns of activity across multiple brain systems including the cortex, thalamus, amygdala, and other structures. The results indicate that emotion categories are not contained within any one region or system, but are represented as configurations across multiple brain networks. The model provides a precise summary of the prototypical patterns for each emotion category, and demonstrates that a sufficient characterization of emotion categories relies on (a) differential patterns of involvement in neocortical systems that differ between humans and other species, and (b) distinctive patterns of cortical-subcortical interactions. Thus, these findings are incompatible with several contemporary theories of emotion, including those that emphasize emotion-dedicated brain systems and those that propose emotion is localized primarily in subcortical activity. They are consistent with componential and constructionist views, which propose that emotions are differentiated by a combination of perceptual, mnemonic, prospective, and motivational elements. Such brain-based models of emotion provide a foundation for new translational and clinical approaches.     

When Learning and Remembering Compete: A Functional MRI Study

Recent functional neuroimaging evidence suggests a bottleneck between learning new information and remembering old information. In two behavioral experiments and one functional MRI (fMRI) experiment, we tested the hypothesis that learning and remembering compete when both processes happen within a brief period of time. In the first behavioral experiment, participants intentionally remembered old words displayed in the foreground, while incidentally learning new scenes displayed in the background. In line with a memory competition, we found that remembering old information was associated with impaired learning of new information. We replicated this finding in a subsequent fMRI experiment, which showed that this behavioral effect was coupled with a suppression of learning-related activity in visual and medial temporal areas. Moreover, the fMRI experiment provided evidence that left mid-ventrolateral prefrontal cortex is involved in resolving the memory competition, possibly by facilitating rapid switching between learning and remembering. Critically, a follow-up behavioral experiment in which the background scenes were replaced with a visual target detection task provided indications that the competition between learning and remembering was not merely due to attention. This study not only provides novel insight into our capacity to learn and remember, but also clarifies the neural mechanisms underlying flexible behavior.     

Endogenous timing in competitive interactions among relatives

Most evolutionary game theory models solve for equilibrium levels of some behaviour on the restrictive assumptions that players choose their actions simultaneously, and that a player cannot change its action after observing that of its opponent. An alternative framework is provided by sequential or 'Stackelberg' games in which one player commits to a 'first move' and the other has an opportunity to observe this move before choosing its response. Recent interest in the economic literature has focused on Stackelberg games which exhibit 'endogenous timing', i.e. games in which a leader and a follower arise spontaneously as a consequence of each player attempting to maximize its reward. Here, we provide the first demonstration of endogenous timing in an evolutionary context using a simple model of resource competition (the 'tug-of-war' model). We show that whenever two related individuals compete for a share of communal resources, both do best to adopt distinct roles in a sequential game rather than engage in simultaneous competition. Somewhat counterintuitively, the stable solution is for the weaker individual to act as leader and commit to a first move, because this arrangement leads to a lower total effort invested in competition. Endogenous timing offers a new explanation for the spontaneous emergence of leaders and followers in social groups, and highlights the benefits of commitment in social interaction.     

听觉皮层信号处理

听觉系统和视觉系统的不同之处在于：听觉系统在外周感受器和听皮层间具有更长的皮层下通路和更多的突触联系。该特殊结构反应了听觉系统从复杂听觉环境中提取与行为相关信号的机制与其他感觉系统不同。听皮层神经信号处理包括两种重要的转换机制,声音信号的非同构转换以及从声音感受到知觉层面的转换。听觉皮层神经编码机制同时也受到听觉反馈和语言或发声过程中发声信号的调控。听觉神经科学家和生物医学工程师所面临的挑战便是如何去理解大脑中这些转换的编码机制。我将会用我实验室最近的一些发现来阐述听觉信号是如何在原听皮层中进行处理的,并讨论其对于言语和音乐在大脑中的处理机制以及设计神经替代装置诸如电子耳蜗的意义。我们使用了结合神经电生理技术和量化工程学的方法来研究这些问题。     

Environmental stress induced by the tumor bed effect leads to subpopulation exclusion within heterogeneous neoplasms: modeling studies

Three nested mathematical models were used to describe the compositional stability of subpopulations within artificial heterogeneous neoplasms in a stressed environment. The first models a microecology in which each subpopulation grows independently and no competition for resources occurs. In the second model, subpopulations compete for common resources, while in the third, the subpopulations compete for resources, and an additional dynamic term describes the emergence of the second population from the first. Environmental stress is a consequence of ionizing radiation damage to the normal tissue in which the tumor grows (the tumor bed effect, TBE). Compositional data observed as a function of time from experimental assays of artificial heterogeneous colon adenocarcinoma xenografts were used for this theoretical analysis. The results show that in the stressed environment, tumor subpopulations do compete for common resources, and that the "weight of competition" (i.e., the rate at which competition can retard total growth) is significantly enhanced. In contrast to unperturbed artificial heterogeneous tumors which exhibit stable composition as a function of time, TBE stress leads to selection of the majority neoplastic population.     

Prey-catching and predator-avoidance in frog and toad: defining the schemas.

The present model postulates the construction of motor actions through the interaction of different motor schemas via a process of competition and co-operation wherein there is no need for a unique schema to win the competition (although that might well be the result) since two or more schemas may simultaneously be active and co-operate to yield a more complicated motor pattern. Based on lesion data, our model is structured on the principles of segregation of co-ordinate systems and participation of maps intermediate between sensory and motor schemas. The motor schemas are driven by specific internal maps which between them constitute a distributed internal representation of the world. These maps collectively provide the transition from topographically-coded sensory information to frequency-coded inputs to the diverse motor schemas that drive muscle activity. We stimulate data on approach and avoidance behavior of the frog or toad under normal conditions and under lesion of different brain centers. For example, the model generates different motor zones for prey-catching behavior which match those observed experimentally in normal conditions and in the medullary hemifield deficit, and offers predictions for new experiments on both approach and avoidance behaviors.