A theory of cerebral learning regulated by the reward system

Hypothetical mechanisms of the neocorticohippocampal system are presented. Neurophysiological and neuroanatomical findings concerning the system are integrated to demonstrate how animals associate sensory stimuli with rewarding actions: (1) cortical plasticity regulated by cholinergic/noradrenergic inputs from the hypothalamic reward system reinforces association connections between the most activated columns in the cortex; (2) the repetitive reinforcement forms association pathways connecting sensory cortical columns activated by the stimuli with motor cortical columns producing the rewarding actions; (3) after the pathways are formed, the cortex is capable of temporarily memorizing the stimuli by producing long-term potentiation through the cortico-hippocampal circuits; and (4) the memory allows the cortex to extend correct association pathways even in an environment where sensory stimuli rapidly change. A mathematical model of parts of the nervous system is presented to quantitatively examine the mechanisms. Membrane characteristics of single neurons are given by the Hodgkin-Huxley electric circuit. According to anatomical data, neural circuits of the neocortico-hippocampal system are composed by connecting populations of the model neurons. Computer simulation using physiological data concerning ion channels demonstrates how the mechanisms work and how to test the hypotheses presented.A preliminary version of this paper was presented at the Fifteenth Annual Meeting of the Japan Neuroscience Society, Tokyo, December 1991     

A memory system in the monkey

A neural model is presented, based largely on evidence from studies in monkeys, postulating that coded representation of stimuli are stored in the higher-order sensory (i.e. association) areas of the cortex whenever stimulus activation of these areas also triggers a cortico-limbo-thalamo-cortical circuit. This circuit, which could act as either an imprinting or rehearsal mechanism, may actually consist of two parallel circuits, one involving the amygdala and the dorsomedial nucleus of the thalamus, and the other the hippocampus and the anterior nuclei. The stimulus representation stored in cortex by action of these circuits is seen as mediating three different memory processes: recognition, which occurs when the stored representation is reactivated via the original sensory pathway; recall, when it is reactivated via any other pathway; and association, when it activates other stored representations (sensory, affective, spatial, motor) via the outputs of the higher-order sensory areas to the relevant structures.     

Synchrony in sensation

How neurons encode information has been a hotly debated issue. Ultimately, any code must be relevant to the senders, receivers, and connections between them. This review focuses on the transmission of sensory information through the circuit linking thalamus and cortex, two distant brain regions. Strong feedforward inhibition in the thalamocortical circuit renders cortex highly sensitive to the thalamic synchrony evoked by a sensory stimulus. Neuromodulators and feedback connections may modulate the temporal sensitivity of such circuits and gate the propagation of synchrony into other layers and cortical areas. The prevalence of strong feedforward inhibitory circuits throughout the central nervous system suggests that synchrony codes and timing-sensitive circuits may be widespread, occurring well beyond sensory thalamus and cortex.     

Sound-driven synaptic inhibition in primary visual cortex

Multimodal objects and events activate many sensory cortical areas simultaneously. This is possibly reflected in reciprocal modulations of neuronal activity, even at the level of primary cortical areas. However, the synaptic character of these interareal interactions, and their impact on synaptic and behavioral sensory responses are unclear. Here, we found that activation of auditory cortex by a noise burst drove local GABAergic inhibition on supragranular pyramids of the mouse primary visual cortex, via cortico-cortical connections. This inhibition was generated by sound-driven excitation of a limited number of cells in infragranular visual cortical neurons. Consequently, visually driven synaptic and spike responses were reduced upon bimodal stimulation. Also, acoustic stimulation suppressed conditioned behavioral responses to a dim flash, an effect that was prevented by acute blockade of GABAergic transmission in visual cortex. Thus, auditory cortex activation by salient stimuli degrades potentially distracting sensory processing in visual cortex by recruiting local, translaminar, inhibitory circuits.     

The role of the prefrontal and parietal cortex in learning and memory in monkeys

Removal of the 7th field of parietal cortex and sulcus principalis of prefrontal cortex did not affect learning processes for images with such properties as spatial frequency, orientation, geometrical form, but worsen learning characteristics in visual differentiation of spatial information making the learning processes unstable, longer and below the 85% level. Removal of sulcus principalis also affects learning of differentiation among various colour stimuli. The short-term memory in these monkeys are also much worse than in intact animals. A scheme of learning involving interacting sensory and cognitive processes controlled by motivation system, is proposed.     

Musings on the wanderer: what's new in our understanding of vago-vagal reflexes? III. Activity-dependent plasticity in vago-vagal reflexes controlling the stomach

Vago-vagal reflex circuits modulate digestive functions from the oral cavity to the transverse colon. Previous articles in this series have described events at the level of the sensory receptors encoding the peripheral stimuli, the transmission of information in the afferent vagus, and the conversion of this data within the dorsal vagal complex (DVC) to impulses in the preganglionic efferents. The control by vagal efferents of the postganglionic neurons impinging on the glands and smooth muscles of the target organs has also been illustrated. Here we focus on some of the mechanisms by which these apparently static reflex circuits can be made quite plastic as a consequence of the action of modulatory inputs from other central nervous system sources. A large body of evidence has shown that the neuronal elements that constitute these brain stem circuits have nonuniform properties and function differently according to status of their target organs and the level of activity in critical modulatory inputs. We propose that DVC circuits undergo a certain amount of short-term plasticity that allows the brain stem neuronal elements to act in harmony with neural systems that control behavioral and physiological homeostasis.     

Learning to hear: plasticity of auditory cortical processing

Sensory experience and auditory cortex plasticity are intimately related. This relationship is most striking during infancy when changes in sensory input can have profound effects on the functional organization of the developing cortex. But a considerable degree of plasticity is retained throughout life, as demonstrated by the cortical reorganization that follows damage to the sensory periphery or by the more controversial changes in response properties that are thought to accompany perceptual learning. Recent studies in the auditory system have revealed the remarkably adaptive nature of sensory processing and provided important insights into the way in which cortical circuits are shaped by experience and learning.     

Distributed representation of perceptual categories in the auditory cortex

Categorical perception is a process by which a continuous stimulus space is partitioned to represent discrete sensory events. Early experience has been shown to shape categorical perception and enlarge cortical representations of experienced stimuli in the sensory cortex. The present study examines the hypothesis that enlargement in cortical stimulus representations is a mechanism of categorical perception. Perceptual discrimination and identification behaviors were analyzed in model auditory cortices that incorporated sound exposure-induced plasticity effects. The model auditory cortex with over-representations of specific stimuli exhibited categorical perception behaviors for those specific stimuli. These results indicate that enlarged stimulus representations in the sensory cortex may be a mechanism for categorical perceptual learning.     

Event-related neuronal responses in the human strio-pallido-thalamic system. II. Cognitive functions

Multiunit activity was recorded from the strio-pallido-thalamic system in the same parkinsonian patients (as described in the previous paper) who bore gold electrodes for diagnosis and therapy. The patients voluntarily participated in various tasks designed to study neuronal correlates of cognitive functions: “odd-omissions,” “short-term memory,” “cued bimodal,” “assessment,” and “dual-stage delayed response” tasks. Preparatory-related activities were found in multiunits reacting to sensory cues. In a few multiunits these activities depended upon the specific features of the stimuli that were anticipated for evaluation. The most striking characteristic of stimulus-related activity was the suppression of the multiunit responses when the stimuli become behaviourally meaningless. The hypothesis of action programming is discussed: the loop, including the cortex, neostriatum, pallidum and appropriate parts of the thalamus, is involved in the selection of actions, thus providing the organization of sequential behaviour.     

The influence of early experience on the development of sensory systems

Once sensory stimuli become able to alter firing patterns in the developing brain, they can influence the maturation of neuronal circuits. Recent experimental studies add to our understanding of precisely which developmental events are affected by early experience. In particular, it appears that experience of the external environment can affect the brain earlier in development and at earlier stages of sensory processing than previously thought. These studies emphasise the developmental importance of the patterning of neuronal firing produced either by sensory stimuli or by spontaneous activity. The timing of action potentials is also an important aspect of several exciting studies describing the mechanisms - anatomical, synaptic, and molecular - by which early experience brings about alterations in the maturation of sensory circuitry. Importantly, this kind of approach can lead to predictions concerning the nature of sensory stimulation that is most effective in instructing brain development.     

Dopaminergic modulation of the P50 auditory-evoked potential in a computer model of the CA3 region of the hippocampus: its relationship to sensory gating in schizophrenia

 We modeled the neuronal circuits that may underlie a sensory-processing deficit associated with schizophrenia. Schizophrenic patients have small P50 auditory-evoked responses to click stimuli compared to normal subjects. The P50 auditory-evoked response is a positive waveform recorded in the EEG approximately 50 ms after the auditory click stimulus. In addition to relatively small amplitudes, schizophrenic patients do not gate or suppress the P50 auditory-evoked response to the second of two paired-click stimuli spaced 0.5 s apart. Neuropleptic medication, which decreases dopaminergic neuronal transmission, increases the amplitude of the P50 auditory-evoked response but does not improve gating. Normal subjects have large P50 auditory-evoked responses to click stimuli when compared to unmedicated schizophrenic patients, and they gate their response to paired click stimuli or have smaller P50 auditory-evoked response amplitudes to the second of two click stimuli spaced 0.5 s apart. Schizophrenic patients do not gate and have similar response amplitudes to both clicks. We hypothesized that the small amplitudes of unmedicated schizophrenic subjects were due to a state of occlusion whereby excessive background noise in local circuits reduced the ability of cells to respond synchronously to sensory input, thereby reducing the amplitude of the P50 waveform in the EEG. Because the P50 auditory-evoked potential amplitudes increased with neuroleptic medication, which reduces dopaminergic neuronal transmission, we hypothesized a role for dopamine in modulating the signal-to-noise (S/N) in the local circuits responsible for sensory gating. To test the hypothesis that modulation of the S/N ratio reduces sensory gating, we developed a model of the effects of dopaminergic neuronal transmission that modulates the S/N in neuronal circuits. The model uses the biologically relevant computer model of the CA3 region of the hippocampus developed in the companion paper [Moxon et al. (2003) Biol Cybern, this volume]. Modified Hebb cell assemblies represented the response of the network to the click stimulus. The results of our model showed that excessive dopaminergic input impaired the ability of cells to respond synchronously to sensory input, which reduced the amplitudes of the P50 evoked responses. Received: 3 December 2001 / Accepted: 23 October 2002 / Published online: 28 February 2003 Correspondence to: K.A. Moxon (e-mail: karen.moxon@drexel.edu, Tel.: +1-215-8951959, Fax: +1-215-8954983) Supported by USPHS, MH01245 & MH58414, MH-01121, and research grants from the Department of Veterans Affairs and the National Alliance for Research on Schizophrenia and Depression.     

Boring's formulation: a scheme for identifying functional neuron groups in a sensory system

In 1935 Edwin Boring proposed that each attribute of sensation reflects the activity of a different neural circuit. If this idea is valid, it could facilitate both psychophysical and neurophysiological research on sensory systems. We think it likely that Boring's formulation is correct for three reasons: 1) Different sensory attributes reflect conscious information about different parameters of a stimulus. To be measured by any device, each of these parameters must be individually computed. Different neural circuits would appear to be necessary for the nervous system to carry out these different computations. 2) Perceived information about different sensory attributes can be made to diverge by appropriate manipulations of the stimuli. If there is a rigorous relationship between conscious sensory experience and neural activity, such a divergence implies that different sensory attributes are served by different neural circuits. 3) Accurate information about a sensory attribute requires that a human observer's attention be focused on that attribute. Changes in direction of attention are thought to involve a process of switching from one neural circuit to another, and provide another way to cause perceived information about different sensory attributes to diverge.     

Synaptic plasticity can produce and enhance direction selectivity

The discrimination of the direction of movement of sensory images is critical to the control of many animal behaviors. We propose a parsimonious model of motion processing that generates direction selective responses using short-term synaptic depression and can reproduce salient features of direction selectivity found in a population of neurons in the midbrain of the weakly electric fish Eigenmannia virescens. The model achieves direction selectivity with an elementary Reichardt motion detector: information from spatially separated receptive fields converges onto a neuron via dynamically different pathways. In the model, these differences arise from convergence of information through distinct synapses that either exhibit or do not exhibit short-term synaptic depression—short-term depression produces phase-advances relative to nondepressing synapses. Short-term depression is modeled using two state-variables, a fast process with a time constant on the order of tens to hundreds of milliseconds, and a slow process with a time constant on the order of seconds to tens of seconds. These processes correspond to naturally occurring time constants observed at synapses that exhibit short-term depression. Inclusion of the fast process is sufficient for the generation of temporal disparities that are necessary for direction selectivity in the elementary Reichardt circuit. The addition of the slow process can enhance direction selectivity over time for stimuli that are sustained for periods of seconds or more. Transient (i.e., short-duration) stimuli do not evoke the slow process and therefore do not elicit enhanced direction selectivity. The addition of a sustained global, synchronous oscillation in the gamma frequency range can, however, drive the slow process and enhance direction selectivity to transient stimuli. This enhancement effect does not, however, occur for all combinations of model parameters. The ratio of depressing and nondepressing synapses determines the effects of the addition of the global synchronous oscillation on direction selectivity. These ingredients, short-term depression, spatial convergence, and gamma-band oscillations, are ubiquitous in sensory systems and may be used in Reichardt-style circuits for the generation and enhancement of a variety of biologically relevant spatiotemporal computations.     

Spontaneous high-gamma band activity reflects functional organization of auditory cortex in the awake macaque

In the absence of sensory stimuli, spontaneous activity in the brain has been shown to exhibit organization at multiple spatiotemporal scales. In the macaque auditory cortex, responses to acoustic stimuli are tonotopically organized within multiple, adjacent frequency maps aligned in a caudorostral direction on the supratemporal plane (STP) of the lateral sulcus. Here, we used chronic microelectrocorticography to investigate the correspondence between sensory maps and spontaneous neural fluctuations in the auditory cortex. We first mapped tonotopic organization across 96 electrodes spanning approximately two centimeters along the primary and higher auditory cortex. In separate sessions, we then observed that spontaneous activity at the same sites exhibited spatial covariation that reflected the tonotopic map of the STP. This observation demonstrates a close relationship between functional organization and spontaneous neural activity in the sensory cortex of the awake monkey.     

Target neuron specification of short-term synaptic facilitation and depression in the cricket CNS

We investigated the role of retrograde signals in the regulation of short-term synaptic depression and facilitation by characterizing the form of plasticity expressed at novel synapses on four giant interneurons in the cricket cercal sensory system. We induced the formation of novel synapses by transplanting a mesothoracic leg and its associated sensory neurons to the cricket terminal abdominal segment. Axons of ectopic leg sensory neurons regenerated and innervated the host terminal abdominal ganglion forming monosynaptic connections with the medial giant interneuron (MGI), lateral giant interneuron (LGI), and interneurons 7-1a and 9-2a. The plasticity expressed by these synapses was characterized by stimulating a sensory neuron with pairs of stimuli at various frequencies or with trains of 10 stimuli delivered at 100 Hz and measuring the change in excitatory postsynaptic potential amplitude recorded in the postsynaptic neuron. Novel synapses of a leg tactile hair on 7-1a depressed, as did control synapses of cercal sensory neurons on this interneuron. Novel synapses of leg campaniform sensilla (CS) sensory neurons on MGI, like MGI's control synapses, always facilitated. The form of plasticity expressed by novel synapses is thus consistent with that observed at control synapses. Leg CS synapses with 9-2a also facilitated; however, the plasticity expressed by these sensory neurons is dependent on the identity of the postsynaptic cell since the synapses these same sensory neurons formed with LGI always depressed. We conclude that the form of plasticity expressed at these synaptic connections is determined retrogradely by the postsynaptic cell. © 1998 John Wiley & Sons, Inc. J Neurobiol 37: 700–714, 1998     

The functional organization of the barrel cortex

The tactile somatosensory pathway from whisker to cortex in rodents provides a well-defined system for exploring the link between molecular mechanisms, synaptic circuits, and behavior. The primary somatosensory cortex has an exquisite somatotopic map where each individual whisker is represented in a discrete anatomical unit, the "barrel," allowing precise delineation of functional organization, development, and plasticity. Sensory information is actively acquired in awake behaving rodents and processed differently within the barrel map depending upon whisker-related behavior. The prominence of state-dependent cortical sensory processing is likely to be crucial in our understanding of active sensory perception, experience-dependent plasticity and learning.     

Sensory processing by neural circuits in Caenorhabditis elegans

The anatomical and developmental constancy of Caenorhabditis elegans belies the complexity of its numerically small nervous system. Indeed, there is an increased appreciation of C. elegans as an organism to study systems level questions. Many recent studies focus on the circuits that control locomotion, egg-laying, and male mating behaviors and their modulation by multiple sensory stimuli.     

Analysis of sensory coding with complex stimuli

Most high-level sensory neurons have complex, nonlinear response properties; a comprehensive characterization of these properties remains a formidable challenge. Recent studies using complex sensory stimuli combined with linear and nonlinear analyses have provided new insights into the neuronal response properties in various sensory circuits.     

Neocortical connectivity during episodic memory formation

During the formation of new episodic memories, a rich array of perceptual information is bound together for long-term storage. However, the brain mechanisms by which sensory representations (such as colors, objects, or individuals) are selected for episodic encoding are currently unknown. We describe a functional magnetic resonance imaging experiment in which participants encoded the association between two classes of visual stimuli that elicit selective responses in the extrastriate visual cortex (faces and houses). Using connectivity analyses, we show that correlation in the hemodynamic signal between face- and place-sensitive voxels and the left dorsolateral prefrontal cortex is a reliable predictor of successful face-house binding. These data support the view that during episodic encoding, "top-down" control signals originating in the prefrontal cortex help determine which perceptual information is fated to be bound into the new episodic memory trace.