A plausible neural circuit for decision making and its formation based on reinforcement learning

A human’s, or lower insects’, behavior is dominated by its nervous system. Each stable behavior has its own inner steps and control rules, and is regulated by a neural circuit. Understanding how the brain influences perception, thought, and behavior is a central mandate of neuroscience. The phototactic flight of insects is a widely observed deterministic behavior. Since its movement is not stochastic, the behavior should be dominated by a neural circuit. Based on the basic firing characteristics of biological neurons and the neural circuit’s constitution, we designed a plausible neural circuit for this phototactic behavior from logic perspective. The circuit’s output layer, which generates a stable spike firing rate to encode flight commands, controls the insect’s angular velocity when flying. The firing pattern and connection type of excitatory and inhibitory neurons are considered in this computational model. We simulated the circuit’s information processing using a distributed PC array, and used the real-time average firing rate of output neuron clusters to drive a flying behavior simulation. In this paper, we also explored how a correct neural decision circuit is generated from network flow view through a bee’s behavior experiment based on the reward and punishment feedback mechanism. The significance of this study: firstly, we designed a neural circuit to achieve the behavioral logic rules by strictly following the electrophysiological characteristics of biological neurons and anatomical facts. Secondly, our circuit’s generality permits the design and implementation of behavioral logic rules based on the most general information processing and activity mode of biological neurons. Thirdly, through computer simulation, we achieved new understanding about the cooperative condition upon which multi-neurons achieve some behavioral control. Fourthly, this study aims in understanding the information encoding mechanism and how neural circuits achieve behavior control. Finally, this study also helps establish a transitional bridge between the microscopic activity of the nervous system and macroscopic animal behavior.     

Neural circuit models for computations in early visual cortex

Some cortical circuit models study the mechanisms of the transforms from visual inputs to neural responses. They model neural properties such as feature tunings, pattern sensitivities, and how they depend on intracortical connections and contextual inputs. Other cortical circuit models are more concerned with computational goals of the transform from visual inputs to neural responses, or the roles of the neural responses in the visual behavior. The appropriate complexity of a cortical circuit model depends on the question asked. Modeling neural circuits of many interacting hypercolumns is a necessary challenge, which is providing insights to cortical computations, such as visual saliency computation, and linking physiology with global visual cognitive behavior such as bottom-up attentional selection.     

Genetic dissection of neural circuits

Understanding the principles of information processing in neural circuits requires systematic characterization of the participating cell types and their connections, and the ability to measure and perturb their activity. Genetic approaches promise to bring experimental access to complex neural systems, including genetic stalwarts such as the fly and mouse, but also to nongenetic systems such as primates. Together with anatomical and physiological methods, cell-type-specific expression of protein markers and sensors and transducers will be critical to construct circuit diagrams and to measure the activity of genetically defined neurons. Inactivation and activation of genetically defined cell types will establish causal relationships between activity in specific groups of neurons, circuit function, and animal behavior. Genetic analysis thus promises to reveal the logic of the neural circuits in complex brains that guide behaviors. Here we review progress in the genetic analysis of neural circuits and discuss directions for future research and development.     

幼年斑马鱼的视觉系统与捕食行为

神经环路的研究是揭示动物行为神经机制的关键。斑马鱼作为一种低等脊椎动物, 在神经环路的研究中有着独特优势。文章描述了斑马鱼视觉系统及其下游的神经环路, 重点讨论了它们在捕食行为中的可能作用。斑马鱼捕食行为主要依赖于视觉功能, 该过程涉及到视觉-运动通路各个层次的神经环路, 包括下游的网状脊髓命令神经元、脊髓内部的运动控制环路以及一些亟待研究的功能单元。随着在体记录和操纵神经元活动技术的成熟, 以及行为学范式的完善, 对斑马鱼捕食行为相关神经环路的研究将在未来数年内迅速发展, 同时也将推动神经科学相关研究的进步。     

Affective empathy and prosocial behavior in rodents

Empathy is an essential function for humans as social animals. Emotional contagion, the basic form of afffective empathy, comprises the cognitive process of perceiving and sharing the affective state of others. The observational fear assay, an animal model of emotional contagion, has enabled researchers to undertake molecular, cellular, and circuit mechanism of this behavior. Such studies have revealed that observational fear is mediated through neural circuits involved in processing the affective dimension of direct pain experiences. A mouse can also respond to milder social stimuli induced by either positive or negative emotional changes in another mouse, which seems not dependent on the affective pain circuits. Further studies should explore how different neural circuits contribute to integrating different dimensions of affective empathy.     

Evolution of behavior and neural control of the fast-start escape response

The fast-start startle behavior is the primary mechanism of rapid escape in fishes and is a model system for examining neural circuit design and musculoskeletal function. To develop a dataset for evolutionary analysis of the startle response, the kinematics and muscle activity patterns of the fast-start were analyzed for four fish species at key branches in the phylogeny of vertebrates. Three of these species (Polypterus palmas, Lepisosteus osseus, and Amia calva) represent the base of the actinopterygian radiation. A fourth species (Oncorhynchus mykiss) provided data for a species in the central region of the teleost phylogeny. Using these data, we explored the evolution of this behavior within the phylogeny of vertebrates. To test the hypothesis that startle features are evolutionarily conservative, the variability of motor patterns and kinematics in fast-starts was described. Results show that the evolution of the startle behavior in fishes, and more broadly among vertebrates, is not conservative. The fast-start has undergone substantial change in suites of kinematics and electromyogram features, including the presence of either a one- or a two-stage kinematic response and change in the extent of bilateral muscle activity. Comparative methods were used to test the evolutionary hypothesis that changes in motor control are correlated with key differences in the kinematics and behavior of the fast-start. Significant evolutionary correlations were found between several motor pattern and behavioral characters. These results suggest that the startle neural circuit itself is not conservative. By tracing the evolution of motor pattern and kinematics on a phylogeny, it is shown that major changes in the neural circuit of the startle behavior occur at several levels in the phylogeny of vertebrates.     

Walter Heiligenberg: the jamming avoidance response and beyond

Walter Heiligenberg (1938–1994) was an exceptionally gifted behavioral physiologist who made enormous contributions to the analysis of behavior and to our understanding of how the brain initiates and controls species-typical behavioral patterns. He was distinguished by his rigorous analytical approach used in both behavioral studies and neuroethological investigations. Among his most significant contributions to neuroethology are a detailed analysis of the computational rules governing the jamming avoidance response in weakly electric fish and the elucidation of the principal neural pathway involved in neural control of this behavior. Based on his work, the jamming avoidance response is perhaps the best-understood vertebrate behavior pattern in terms of the underlying neural substrate. In addition to this pioneering work, Heiligenberg stimulated research in a significant number of other areas of ethology and neuroethology, including: the quantitative assessment of aggressivity in cichlid fish; the ethological analysis of the stimulus–response relationship in the chirping behavior of crickets; the exploration of the neural and endocrine basis of communicatory behavior in weakly electric fish; the study of cellular mechanisms of neuronal plasticity in the adult fish brain; and the phylogenetic analysis of electric fishes using a combination of morphology, electrophysiology, and mitochondrial sequence data.T. H. Bullock: deceased 2005     

The neural circuits and synaptic mechanisms underlying motor initiation in C. elegans

C. elegans is widely used to dissect how neural circuits and genes generate behavior. During locomotion, worms initiate backward movement to change locomotion direction spontaneously or in response to sensory cues; however, the underlying neural circuits are not well defined. We applied a multidisciplinary approach to map neural circuits in freely behaving worms by integrating functional imaging, optogenetic interrogation, genetic manipulation, laser ablation, and electrophysiology. We found that a disinhibitory circuit and a stimulatory circuit together promote initiation of backward movement and that circuitry dynamics is differentially regulated by sensory cues. Both circuits require glutamatergic transmission but depend on distinct glutamate receptors. This dual mode of motor initiation control is found in mammals, suggesting that distantly related organisms with anatomically distinct nervous systems may adopt similar strategies for motor control. Additionally, our studies illustrate how a multidisciplinary approach facilitates dissection of circuit and synaptic mechanisms underlying behavior in a genetic model organism.     

Evolutionary conservation of mechanisms for neural regionalization, proliferation and interconnection in brain development

Comparative studies of brain development in vertebrate and invertebrate model systems demonstrate remarkable similarities in expression and action of developmental control genes during embryonic patterning, neural proliferation and circuit formation in the brain. Thus, comparable sets of developmental control genes are involved in specifying the early brain primordium as well as in regionalized patterning along its anteroposterior and dorsoventral axes. Furthermore, similar cellular and molecular mechanisms underlie the formation and proliferation of neural stem cell-like progenitors that generate the neurons in the central nervous systems. Finally, neural identity and some complex circuit interconnections in specific brain domains appear to be comparable in vertebrates and invertebrates and may depend on similar developmental control genes.     

A novel neural substrate for the transformation of olfactory inputs into motor output

It is widely recognized that animals respond to odors by generating or modulating specific motor behaviors. These reactions are important for daily activities, reproduction, and survival. In the sea lamprey, mating occurs after ovulated females are attracted to spawning sites by male sex pheromones. The ubiquity and reliability of olfactory-motor behavioral responses in vertebrates suggest tight coupling between the olfactory system and brain areas controlling movements. However, the circuitry and the underlying cellular neural mechanisms remain largely unknown. Using lamprey brain preparations, and electrophysiology, calcium imaging, and tract tracing experiments, we describe the neural substrate responsible for transforming an olfactory input into a locomotor output. We found that olfactory stimulation with naturally occurring odors and pheromones induced large excitatory responses in reticulospinal cells, the command neurons for locomotion. We have also identified the anatomy and physiology of this circuit. The olfactory input was relayed in the medial part of the olfactory bulb, in the posterior tuberculum, in the mesencephalic locomotor region, to finally reach reticulospinal cells in the hindbrain. Activation of this olfactory-motor pathway generated rhythmic ventral root discharges and swimming movements. Our study bridges the gap between behavior and cellular neural mechanisms in vertebrates, identifying a specific subsystem within the CNS, dedicated to producing motor responses to olfactory inputs.     

Testicular hormone exposure during adolescence organizes flank-marking behavior and vasopressin receptor binding in the lateral septum

Adolescence is a period during which many social behaviors emerge. One such behavior, flank marking, is a testosterone-modulated scent marking behavior that communicates dominance status between adult male Syrian hamsters. Testosterone modulates flank-marking behavior by altering neural transmission of vasopressin within a forebrain circuit. This study tested whether testicular hormones secreted during adolescence play purely a transient activational role in the display of flank-marking behavior, or whether adolescent steroid hormone secretions also cause long-term organizational changes in vasopressin binding within brain regions underlying flank-marking behavior. We tested this hypothesis by manipulating whether testicular secretions were present during adolescent development and then tested for flank-marking behavior and vasopressin receptor binding within the flank-marking neural circuit in young adulthood. Specifically, males were gonadectomized immediately before or after adolescence, replaced with testosterone 6 weeks following gonadectomy in young adulthood, and behavior tested 1 week later. Adult testosterone treatment activated flank-marking behavior only in males that were exposed to testicular hormones during adolescence. In addition, males exposed to testicular hormones during adolescence exhibited significantly less vasopressin receptor binding within the lateral septum than males deprived of adolescent hormones, suggesting that hormone-dependent remodeling of synapses normally occurs in the lateral septum during adolescence. These data highlight the importance of gonadal steroid hormone exposure during adolescence for the organization of neural circuits and social behavior.     

Cracking the combinatorial semaphorin code

In this issue of Neuron, Wu et?al. describe a combinatorial code of repulsive Sema-2a and attractive Sema-2b signaling that mediates mechanosensory axonal guidance, fasciculation, and synaptic target selection within the CNS of Drosophila. Their work exemplifies how a detailed, multilevel molecular-genetic analysis (from molecules to behavior) provides fundamental insights into neural circuit development.     

‘Glocal’ Robustness Analysis and Model Discrimination for Circadian Oscillators

To characterize the behavior and robustness of cellular circuits with many unknown parameters is a major challenge for systems biology. Its difficulty rises exponentially with the number of circuit components. We here propose a novel analysis method to meet this challenge. Our method identifies the region of a high-dimensional parameter space where a circuit displays an experimentally observed behavior. It does so via a Monte Carlo approach guided by principal component analysis, in order to allow efficient sampling of this space. This ‘global’ analysis is then supplemented by a ‘local’ analysis, in which circuit robustness is determined for each of the thousands of parameter sets sampled in the global analysis. We apply this method to two prominent, recent models of the cyanobacterial circadian oscillator, an autocatalytic model, and a model centered on consecutive phosphorylation at two sites of the KaiC protein, a key circadian regulator. For these models, we find that the two-sites architecture is much more robust than the autocatalytic one, both globally and locally, based on five different quantifiers of robustness, including robustness to parameter perturbations and to molecular noise. Our ‘glocal’ combination of global and local analyses can also identify key causes of high or low robustness. In doing so, our approach helps to unravel the architectural origin of robust circuit behavior. Complementarily, identifying fragile aspects of system behavior can aid in designing perturbation experiments that may discriminate between competing mechanisms and different parameter sets.     

A resource of Cre driver lines for genetic targeting of GABAergic neurons in cerebral cortex

A key obstacle to understanding neural circuits in the?cerebral cortex is that of unraveling the diversity of GABAergic interneurons. This diversity poses general questions for neural circuit analysis: how are these interneuron cell types generated and assembled into stereotyped local circuits and how do they differentially contribute to circuit operations that underlie cortical functions ranging from perception to cognition? Using genetic engineering in mice, we have generated and characterized approximately 20 Cre and inducible CreER knockin driver lines that reliably target major classes and lineages of GABAergic neurons. More select populations are captured by intersection of Cre and Flp drivers. Genetic targeting allows reliable identification, monitoring, and manipulation of cortical GABAergic neurons, thereby enabling a systematic and comprehensive analysis from cell fate specification, migration, and connectivity, to their functions in network dynamics and behavior. As such, this approach will accelerate the study of GABAergic circuits throughout the mammalian brain.     

Aromatase activity in the rat brain: Hormonal regulation and sex differences

The intracellular conversion of testosterone to estradiol by the aromatase enzyme complex is an important step in many of the central actions of testosterone. In rats, estrogen given alone, or in combination with dihydrotestosterone, mimics most of the behavioral effects of testosterone, whereas treatment with antiestrogens or aromatase inhibitors block facilitation of copulatory behavior by testosterone. We used a highly sensitive in vitro radiometric assay to analyze the distribution and regulation of brain aromatase activity. Studies using micropunch dissections revealed that the highest levels of aromatase activity are found in an interconnected group of sexually dimorphic nuclei which constitutes a neural circuit important in the control of male sexual behavior. Androgen regulated aromatase activity in many diencephalic nucleic, including the medial preoptic nucleus, but not in the medial and cortical nuclei of the amygdala. Additional genetic evidence for both androgen-dependent and -independent control of brain AA was obtained by studies of androgen-insensitive testicular-feminized rats. These observations suggest that critical differences in enzyme responsiveness are present in different brain areas. Within several nuclei, sex differences in aromatase induction correlated with differences in nuclear androgen receptor concentrations suggesting that neural responsiveness to testosterone is sexually differentiated. Estradiol and dihydrotestosterone acted synergistically to regulate aromatase activity in the preoptic area. In addition, time-course studies showed that estrogen treatment increased the duration of nuclear androgen receptor occupation in the preoptic area of male rats treated with dihydrotestosterone. These results suggest possible ways that estrogens and androgens may interact at the cellular level to regulate neural function and behavior.     

Stochastic formulation for a partial neural circuit of <Emphasis Type="Italic">C. elegans</Emphasis>

We present a stochastic formulation for a partial neural circuit of Caenorhabditis elegans. This study is concerned with how to reduce the degree of freedom in a large neural circuit. In the presented formulation, neurons in the whole neural circuit are divided into two complementary groups. One is the neurons which are mainly associated with a certain behavior, and the other is the remaining neurons of C. elegans. In an ordinary study on a partial neural circuit, the influence of the latter (the remaining neurons) on the former (the associated neurons) is completely neglected. In the presented formulation, however, the influence is expressed by a stochastic variable. The structure of the ensemble for the stochastic variable is appropriately evaluated by the neural connectivity of C. elegans since the neural connectivity of C. elegans has been completely determined. In this way, the degree of freedom is effectively reduced. We apply the presented formulation to determine the synaptic signs in the touch sensitivity circuit of C. elegans. The synaptic signs are determined to satisfy the locomotory behaviors in C. elegans. We find that the influence of the remaining neurons on the touch sensitivity circuit is important to determine the synaptic signs.     

Research progress on Drosophila visual cognition in China

Visual cognition,as one of the fundamental aspects of cognitive neuroscience,is generally associated with high-order brain functions in animals and human.Drosophila,as a model organism,shares certain features of visual cognition in common with mammals at the genetic,molecular,cellular,and even higher behavioral levels.From learning and memory to decision making,Drosophila covers a broad spectrum of higher cognitive behaviors beyond what we had expected.Armed with powerful tools of genetic manipulation in Drosophila,an increasing number of studies have been conducted in order to elucidate the neural circuit mechanisms underlying these cognitive behaviors from a genes-brain-behavior perspective.The goal of this review is to integrate the most important studies on visual cognition in Drosophila carried out in mainland China during the last decade into a body of knowledge encompassing both the basic neural operations and circuitry of higher brain function in Drosophila.Here,we consider a series of the higher cognitive behaviors beyond learning and memory,such as visual pattern recognition,feature and context generalization,different feature memory traces,salience-based decision,attention-like behavior,and cross-modal leaning and memory.We discuss the possible general gain-gating mechanism implementing by dopamine-mushroom body circuit in fly's visual cognition.We hope that our brief review on this aspect will inspire further study on visual cognition in flies,or even beyond.     

Imaging circuit formation in zebrafish

The study of nervous system development has been greatly facilitated by recent advances in molecular biology and imaging techniques. These approaches are perfectly suited to young transparent zebrafish where they have allowed direct observation of neural circuit assembly in vivo. In this review we will highlight a number of key studies that have applied optical and genetic techniques in zebrafish to address questions relating to axonal and dendritic arbor development,synapse assembly and neural plasticity. These studies have revealed novel cellular phenomena and modes of growth that may reflect general principles governing the assembly of neural circuits.     

Deciphering the neural and molecular mechanisms of C. elegans behavior

Because of its small and well-characterized nervous system and amenability to genetic manipulation, the nematode Caenorhabditis elegans offers the promise of understanding the mechanisms underlying a whole animal's behavior at the molecular and cellular levels. In fact, this goal was a primary motivation behind the development of C. elegans as an experimental organism 40 years ago. Yet it has proven surprisingly difficult to obtain a mechanistic understanding of how the C. elegans nervous system generates behavior, despite the existence of a 'wiring diagram' that contains a degree of information about neural connectivity unparalleled in any organism. This review describes three types of information--molecular data on cellular neurochemistry, temporal information about neural activity patterns, and behavioral data on the consequences of neural ablation and manipulation--that, along with genetic analysis, may ultimately lead to a complete functional map of the C. elegans nervous system.