Adaptive timing in neural networks: The conditioned response

A conditioned response not only reflects knowledge of an association between two events, a CS and a US, it also reflects knowledge about the timing of these events. A neural network and set of learning rules that generates appropriately timed conditioned response waveforms is presented. The model is capable of simulating some of the basic temporal properties of conditioned responses exhibited in biological systems, including (1) decreasing onset latency during acquisition training, (2) peak amplitude accurring at the temporal locus of the US, (3) inhibition of delay, and (4) trace conditioning. The model is also capable of simulating complex CR waveforms under certain conditions, and these simulations are compared with the results of behavioral experiments. The temporally adaptive responses are achieved by virtue of stimulus trace processes that are built into the network architecture.     

Hippocampal place cells acquire location-specific responses to the conditioned stimulus during auditory fear conditioning

We recorded neurons from the hippocampus of freely behaving rats during an auditory fear conditioning task. Rats received either paired or unpaired presentations of an auditory conditioned stimulus (CS) and an electric shock unconditioned stimulus (US). Hippocampal neurons (place and theta cells) acquired responses to the auditory CS in the paired but not in the unpaired group. After CS-US pairing, rhythmic firing of theta cells became synchronized to the onset of the CS. Conditioned responses of place cells were gated by their location-specific firing, so that after CS-US pairing, place cells responded to the CS only when the rat was within the cell's place field. These findings may help to elucidate how the hippocampus contributes to context-specific memory formation during associative learning.     

Autoshaping in the rat: conditioned licking response to a stimulus that signals sucrose reinforcement

The present experiments were designed to determine if repeated presentations of an empty sipper tube (the conditioned stimulus or CS) with the response-independent delivery of a sucrose solution (the unconditioned stimulus or US) from a second spout results in the development of Pavlovian conditioned responding. In Experiment 1, rats in the experimental condition received paired CS-US presentations whereas subjects in the control condition were exposed to random presentations of CS and US. In Experiment 2, an additional control condition (CS alone) was included and, to encourage generalized responding between the US and CS, the CS tube was filled with water for all groups. The results of both experiments indicate that the CS-directed responding in the paired CS-US condition was Pavlovian in nature. Thus, the present procedure serves as an autoshaping task in which conditioned licking is generated.     

Molecular signaling during taste aversion learning

Behavioral and neural assessment tools have been used to identify cellular and molecular events that occur during taste aversion acquisition. Studies described here include an assessment of taste information processing and taste-illness association using fos-like immunoreactivity (FLI) to mark populations of cells that react strongly to the taste conditioned stimulus (CS), the illness unconditioned stimulus (US), or the pairing of CS and US. Exposure to a novel, but not a familiar, CS taste (saccharin) was found to induce robust increases in FLI in some, but not all, brain regions previously implicated in taste processing or taste aversion learning. Striking effects of taste novelty on FLI were found in central amygdala (CNA) and insular cortex (IC) but not in basolateral amygdala (BLA), pontine parabrachial nucleus (PBN), or nucleus of the solitary tract (NTS). Of those regions responding to taste novelty, only CNA showed significant elevations in FLI in response to the US, LiCl. In additional studies, FLI was examined after an effective training experience, novel CS-US pairing, and compared with an ineffective one, familiar CS-US pairing. After CS-US pairing, taste novelty modulated FLI in virtually all the regions previously implicated in conditioned taste aversion (CTA) learning, including PBN, CNA, BLA, IC, as well as NTS. Thus, a distributed and interdependent neural CTA circuit is mapped using this method, and the use of localized lesion and inactivation studies promises to further define the functional role of structures within this circuit.     

A time contraction effect of acute tail-pinch stress on the associative learning of rats

The effect of tail-pinch stress interpolated between the saccharin conditioned stimulus (CS) and the illness-inducing unconditioned stimulus (US) during long-trace taste-aversion conditioning was examined in young- and old adult rats with a two-cylinder (saccharin versus water) test. A 2 x 2 x 4 factorial ANOVA was performed on percent-preference-for-saccharin data, with age (young, old), stress condition (stressed, non-stressed), and CS-US interval (22.5-, 45-, 90-, and 180-min) being the factors under consideration. The ANOVA yielded only significant main effects of stress condition and CS-US interval. These findings indicate that stress weakens the CS-US association as evidenced by a higher percent preference for saccharin in the stressed rats than in non-stressed rats at all CS-US intervals. A comparison of the stressed and non-stressed conditioned rats with pseudo-conditioned controls showed that the non-stressed rats formed strong aversions up to the 45-min CS-US interval whereas the stressed rats showed no conditioning beyond the 22.5 min CS-US interval, indicating that stress decreases the effective CS-US interval. Results were interpreted in terms of time-contraction and an internal biological countdown timer hypothesized to govern processes involved in associative learning over long delays.     

Properties of olfactory conditioning in the housefly, Musca domestica

The housefly, Musca domestica, was conditioned to odours using the proboscis extension response to labellar stimulation with sucrose solution as an unconditioned response and the properties of conditioning were investigated. Among trials including forward pairing of the conditioned stimulus (CS) with the unconditioned stimulus (US), backward pairing and isolated presentations of CS and US, only forward pairing is effective on the acquisition of conditioning. Backward pairing combined with forward pairing does not influence the effectiveness of the forward pairing. CS given overlapping with a US presentation permits only weak conditioning. The acquisition of conditioning decreases with increase of the CS-US interval. In the differential conditioning situation to two odours, discriminative responses are observed. In the flies conditioned with one antenna, the conditioned response is elicited not only by stimulation of the antenna used for conditioning but also by stimulation of the antenna not used for conditioning, although the response using the former is higher than with the latter. The ability to be conditioned is reduced immediately after fastening on a clay bed and increases with time. Ability can also be improved by transection of the ventral nerve cord.     

Evoked potential correlates of early conditioning in the rat ontogeny.

In rats aged 2-8 weeks cortical EP to CS (20 flash - tone combinations, 0,9/sec, reinforced since the 10th application by electric shocks to the hind leg) were studied within different kinds of behavioral responses during avoidance learning and extinguishing. In contrast to our results in freely moving rats no developmental trend was found in this kind of avoidance (lifting of the hind leg). Average EP within reinforced trials (with escape or no reactions) differed in isolated application of CS from those when both CS and US were acting together. In younger animals the EP to CS combined with US were characterized by an evident late negative wave which shifted later (5-6 weeks toward the early negative complex. The EP changes in the auditory cortex were more pronounced, whereas visual EP with CS-US combination were rather decreased. In the youngest animals (2 weeks) the auditory EP within trials with avoidance were characterized by a distinct short latency deflection of the first positive wave, whereas in EP to extinguished CS the second deflection of the first positive wave prevailed. Also in these phenomena, the typical changes were clearly revealed in the auditory cortex. At later developmental stages (starting the 3rd, more prominently the 4th and 5th week) the wave following primary positive - negative complex was shifted toward the negativity if the animal responded by an avoidance; on the contrary an ample positive, often a double-peak wave arose if the response was extinguished. The stimulus and reaction dependence in the cortical EP showed the role of not yet fully mature cerebral cortex in avoidance learning. Both, fast as well as with some delay running processes participated in the observed phenomena during the ontogenetical development.     

Stimulus representation in SOP: II. An application to inhibition of delay

The componential extension of SOP accounts for conditioned response (CR) timing in Pavlovian conditioning by assuming that learning accrues with relative independence to stimulus elements that are differentially occasioned during the duration of the conditioned stimulus (CS). SOP, using a competitive learning rule and the assumption that temporal learning emerges via resolution of what is equivalent to an "AX+BX-" discrimination, predicts a progressive increase in the latency of the CR over training, or what Pavlov refer to as "inhibition of delay." Other componential models, which use noncompetitive learning rules, do not predict inhibition of delay. Either type of model makes the prediction indicated, independently of the length of the CS-unconditioned stimulus (US) interval. We report two experiments that demonstrated inhibition of delay when rabbits were trained with relatively long, but not with short, CS-US intervals. To account for this divergence, we assumed that the SOP stimulus trace involves two kinds of elements, some with a temporally distributed pattern of activity over the duration of the CS duration, and some with a randomly distributed pattern. This stimulus representation, not only allows for inhibition of delay with long but not short CS-US intervals, but in combination with SOP's performance rule deduces CR's with "Weber variability."     

Changes in potentiation and timing of sensorimotor transmission after adaptation of a postsynaptic transient outward current in a simulated cortical neuron

How adaptation of a postsynaptic transient outward current might affect the efficacy of sensorimotor transmission was investigated. The transmission signals that were studied were a 5 ms conditioned stimulus (CS) and a 60 ms US drawn from intracellularly recorded, depolarizing postsynaptic potentials (PSPs) elicited in pyramidal neurons of the cat motor cortex by a click CS and a glabella tap US, respectively. SPICE, a program used to analyze electrical circuits, was used to simulate the cortical neuron containing the adaptive outward current. Changes in the magnitude and latency of rise to firing threshold of the PSPs were compared i) after presynaptic augmentation of a CS input in the absence of an adaptive postsynaptic current and ii) after decreasing the magnitude of an adaptive postsynaptic current that was rapidly activated by depolarization. Effects of short (6 ms) and long (24 ms) inactivation time constants of the postsynaptic current were also studied. In both presynaptic adaptation and postsynaptic adaptation, the potentiation of the magnitude of the CS-induced PSP was similar, with the latency to threshold being reduced by " 1 ms in both cases. The effects on the US PSP differed. Presynaptic adaptation affecting the CS had no effect on the US. Adaptation of the CS by a postsynaptic outward current with a 6 ms inactivation time constant, reduced the latency to threshold of an EPSP from a nearby US synapse by up to 6 ms by augmenting the initial portion of the slowly rising US-induced PSP. Adaptation of a postsynaptic current with a 24 ms inactivation time constant reduced the latency of response to the US PSP by up to 16 ms. When the US synapse was relocated to the soma, the reduction in US latency caused by adaptation of the outward current at the CS synapse was reduced by up to one half. The latency of slowly rising components of integrated synaptic responses to compound CSs of > 5 ms duration from multiple synaptic inputs would be expected to show reductions corresponding to those of the US. We conclude that potentiation of synaptic transmission by adaptation of a postsynaptic outward current can result in reductions of latency of sensorimotor transmission that can significantly affect the timing and accuracy of controlled motor tasks. These effects depend significantly on the locations of the synaptic inputs within the cell.     

Changes in potentiation and timing of sensorimotor transmission after adaptation of a postsynaptic transient outward current in a simulated cortical neuron

How adaptation of a postsynaptic transient outward current might affect the efficacy of sensorimotor transmission was investigated. The transmission signals that were studied were a 5 ms conditioned stimulus (CS) and a 60 ms US drawn from intracellularly recorded, depolarizing postsynaptic potentials (PSPs) elicited in pyramidal neurons of the cat motor cortex by a click CS and a glabella tap US, respectively. SPICE, a program used to analyze electrical circuits, was used to simulate the cortical neuron containing the adaptive outward current. Changes in the magnitude and latency of rise to firing threshold of the PSPs were compared i) after presynaptic augmentation of a CS input in the absence of an adaptive postsynaptic current and ii) after decreasing the magnitude of an adaptive postsynaptic current that was rapidly activated by depolarization. Effects of short (6 ms) and long (24 ms) inactivation time constants of the postsynaptic current were also studied. In both presynaptic adaptation and postsynaptic adaptation, the potentiation of the magnitude of the CS-induced PSP was similar, with the latency to threshold being reduced by < or = 1 ms in both cases. The effects on the US PSP differed. Presynaptic adaptation affecting the CS had no effect on the US. Adaptation of the CS by a postsynaptic outward current with a 6 ms inactivation time constant, reduced the latency to threshold of an EPSP from a nearby US synapse by up to 6 ms by augmenting the initial portion of the slowly rising US-induced PSP. Adaptation of a postsynaptic current with a 24 ms inactivation time constant reduced the latency of response to the US PSP by up to 16 ms. When the US synapse was relocated to the soma, the reduction in US latency caused by adaptation of the outward current at the CS synapse was reduced by up to one half. The latency of slowly rising components of integrated synaptic responses to compound CSs of > 5 ms duration from multiple synaptic inputs would be expected to show reductions corresponding to those of the US. We conclude that potentiation of synaptic transmission by adaptation of a postsynaptic outward current can result in reductions of latency of sensorimotor transmission that can significantly affect the timing and accuracy of controlled motor tasks. These effects depend significantly on the locations of the synaptic inputs within the cell.     

External inhibition in a goldfish (Carassius auratus) classical conditioning situation

Goldfish were classically conditioned with a light as the CS and shock as the US. The UR was a decrease in respiration. After 15 or 60 conditioning trials the fish were tested with novel stimuli (clicks) during the CS-US interval. High and moderate intensity novel stimuli produced a significant decrease in CRs (external inhibition) for fish with 60 conditioning trials (5.5 or 10.5 sec CS-US interval), but not fish with 15 conditioning trials. Low intensity novel stimuli produced no evidence for disinhibition (an increase in CRs). Control groups (e.g., groups with random presentations of the CS and US) showed that the external inhibition for fish with 60 conditioning trials was inhibition of a true CR.     

Altering the synchrony of stimulus trace processes: tests of a neural-network model

A previously described neural-network model (Desmond 1991; Desmond and Moore 1988; Moore et al. 1989) predicts that both CS-onset-evoked and CS-offset-evoked stimulus trace processes acquire associative strength during classical conditioning, and that CR waveforms can be altered by manipulating the time at which the processes are activated. In a trace conditioning paradigm, where CS offset precedes US onset, the model predicts that onset and offset traces act in synchrony to generate unimodal CR waveforms. However, if the CS duration is subsequently lengthened on CS-alone probe trials, the model predicts that onset and offset traces will asynchronously contribute to CR output and bimodal CRs will be generated. In a delay conditioning paradigm, in which US onset occurs prior to CS offset, the model predicts that only the onset process will gain associative strength, and hence, only unimodal CRs will occur. Using the rabbit conditioned nictitating membrane response preparation, we found experimental support for these predictions.This research was supported by National Science Foundation grant BNS 88-10624 and Air Force Office of Scientific Research grant 89-0391.     

Modeling colonization rates over time: Generating null models and testing model adequacy in phylogenetic analyses of species assemblages*

A central theme connecting macroevolutionary processes to macroecological patterns is the shaping of regional biodiversity over time through speciation, extinction, migration, and range shifts. The use of phylogenies to explore the dynamics of diversification due to variation in speciation and extinction rates has been well-developed and there are established methods for inferring speciation times from phylogenies and generating its null distributions (as represented by node heights on molecular phylogenies). But inferring colonization events from phylogenies is more challenging. Unlike speciation events, represented by nodes, colonization events could occur at any point along a branch connecting species in the assemblage to the regional pool. We account for uncertainty in identification of colonization lineages and timing of colonization events by using an efficient analytical solution to inferring the distribution of colonization times from an assemblage phylogeny. Using the same solution, we efficiently derive the null distribution of colonization times, which provides us with a general approach to testing the adequacy of a model to describe colonization events into the assemblage. We illustrate this approach by demonstrating how the movement of squamate lineages into Madagascar has been uneven over time, peaking in the early Cenozoic when ocean conditions favored colonization.     

Neural-network simulations of two context-dependence phenomena

This paper describes simulations of two context-dependence phenomena in Pavlovian conditioning, using a neural-network model that draws on knowledge from neuroscience and makes no distinction between operant and respondent learning mechanisms. One phenomenon is context specificity or the context-shift effect, the decrease of conditioned responding (CR) when the conditioned stimulus (CS) is tested in a context different from the one in which it had been paired with the unconditioned stimulus (US). The other effect is renewal, the recovery of CR in the training context after extinction in another context. For specificity (simulation 1), two neural networks were first given 200 CS-US pairings in a context. Then, the CS was tested either in the training context or a new context. Output activations in the new context were substantially lower. For renewal (simulation 2), two networks were first given 200 CS-US pairings in a context, then 100 extinction trials in either the same context or a new one, and then tested back in the training context. Output activations during the test phase were substantially higher after extinction in a new context. The results are interpreted in terms of the dynamics of activations and weights.     

Extension of the CS past the US can facilitate conditioning of the rabbit's nictitating membrane response

Five experiments were conducted in which the onset of a tone conditioned stimulus (CS) preceded the unconditioned stimulus (US) by 500 ms. Across experiments, the offset of the CS was extended past the offset of the US by values ranging from 0 ms to 40000 ms. Extensions of the CS of 2000 ms or greater produced acquisition of a conditioned response (CR) that was as fast or faster than in the no-extension condition (0 ms). While extension of a forward tone CS after the US enhanced excitatory conditioning, insertion of another CS (light) in a purely backward relationship with the US passed only a retardation test, indicative of latent inhibition, and not a summation test needed for conditioned inhibition. The results add to the evidence that excitatory and inhibitory processes are both engaged following US offset. Alternative theories of CS processing are discussed.     

Do CS-US Pairings Actually Matter? A Within-Subject Comparison of Instructed Fear Conditioning with and without Actual CS-US Pairings

Previous research showed that instructions about CS-US pairings can lead to fear of the CS even when the pairings are never presented. In the present study, we examined whether the experience of CS-US pairings adds to the effect of instructions by comparing instructed conditioning with and without actual CS-US pairings in a within-subject design. Thirty-two participants saw three fractals as CSs (CS⁺1, CS⁺2, CS⁻) and received electric shocks as USs. Before the start of a so-called training phase, participants were instructed that both CS⁺1 and CS⁺2 would be followed by the US, but only CS⁺1 was actually paired with the US. The absence of the US after CS⁺2 was explained in such a way that participants would not doubt the instructions about the CS⁺2-US relation. After the training phase, a test phase was carried out. In this phase, participants expected the US after both CS⁺s but none of the CS⁺s was actually paired with the US. During test, self-reported fear was initially higher for CS⁺1 than for CS⁺2, which indicates that the experience of actual CS-US pairings adds to instructions about these pairings. On the other hand, the CS⁺s elicited similar skin conductance responses and US expectancies. Theoretical and clinical implications are discussed.     

Training-Dependent Associative Learning Induced Neocortical Structural Plasticity: A Trace Eyeblink Conditioning Analysis

Studies utilizing general learning and memory tasks have suggested the importance of neocortical structural plasticity for memory consolidation. However, these learning tasks typically result in learning of multiple different tasks over several days of training, making it difficult to determine the synaptic time course mediating each learning event. The current study used trace-eyeblink conditioning to determine the time course for neocortical spine modification during learning. With eyeblink conditioning, subjects are presented with a neutral, conditioned stimulus (CS) paired with a salient, unconditioned stimulus (US) to elicit an unconditioned response (UR). With multiple CS-US pairings, subjects learn to associate the CS with the US and exhibit a conditioned response (CR) when presented with the CS. Trace conditioning is when there is a stimulus free interval between the CS and the US. Utilizing trace-eyeblink conditioning with whisker stimulation as the CS (whisker-trace-eyeblink: WTEB), previous findings have shown that primary somatosensory (barrel) cortex is required for both acquisition and retention of the trace-association. Additionally, prior findings demonstrated that WTEB acquisition results in an expansion of the cytochrome oxidase whisker representation and synaptic modification in layer IV of barrel cortex. To further explore these findings and determine the time course for neocortical learning-induced spine modification, the present study utilized WTEB conditioning to examine Golgi-Cox stained neurons in layer IV of barrel cortex. Findings from this study demonstrated a training-dependent spine proliferation in layer IV of barrel cortex during trace associative learning. Furthermore, findings from this study showing that filopodia-like spines exhibited a similar pattern to the overall spine density further suggests that reorganization of synaptic contacts set the foundation for learning-induced neocortical modifications through the different neocortical layers.     

Orexin受体1对摄食条件反射的调控研究

目的:观察Orexin受体1对摄食条件反射的调控研究。方法:将40只大鼠随机分为四组,分别为NS/NS组,SB/SB组,NS/SB组,SB/NS组,每组10只大鼠,给予大鼠八组"条件刺激-无条件刺激(CS-US)"训练,给予无条件刺激后立即进行条件刺激,每组进行训练前30 min给予SB或生理盐水(NS)。获得性训练后,给予2组反射消失性训练,即给予8次条件刺激。条件刺激是给予大鼠10 s,2kHZ声音刺激,无条件刺激是直接给予大鼠食物。结果:给予条件刺激后,四组大鼠摄食行为均明显增加,摄食间隔均明显缩短,当条件刺激强度增加时,摄食行为也增加,而预先给予SB,与NS/NS组相比,其余组大鼠摄食行为相对减少(P0.05),摄食间隔增加。消失性训练中,与NS/NS,NS/SB组相比,SB/NS组和SB/SB组大鼠摄食行为明显减少(P0.05)。与其他三组大鼠相比,SB/NS组大鼠摄食间隔缩短。预先给予SB使后两次刺激后摄食间隔明显增加(P0.05)。结论:OX1R信号通路调控摄食反射的产生和消失。     

The reflection of the operations of comparing afferent flow with internal pretuning in the neuronal impulse activity of the frontal cortex in the dog

From 192 neurons, recorded in the frontal cortex of dogs trained for differential classical conditioning of salivary reflex, 24 cells were identified related to the detection of matching-mismatching conditioned and unconditioned stimuli (CS and US) to internal set. Impulse reactions of the 1-st group of neurones (11 cells) to US disappeared, when any deviation from standard pattern of CS-US pairing occurred or when US characteristics were suddenly changed. These reactions developed again at the 3-5th repeated presentation of the stimuli delivered in "new" regime. Neurones of the 2-nd group (13 cells) were activated in response to CS only when two sequential CSs had different meaning. The 1-st group of neurones is considered as detectors of matching, and the 2-nd group--as detectors of mismatching the stimulus to its neural model, formed by mechanism of reinforcement.     

Appetitive and aversive learning in Spodoptera littoralis larvae

Adult Lepidoptera are capable of associative learning. This helps them to forage flowers or to find suitable oviposition sites. Larval learning has never been seriously considered because they have limited foraging capabilities and usually depend on adults as concerns their food choices. We tested if Spodoptera littoralis larvae can learn to associate an odor with a tastant using a new classical conditioning paradigm. Groups of larvae were exposed to an unconditioned stimulus (US: fructose or quinine mixed with agar) paired with a conditioned stimulus (CS: hexanol, geraniol or pentyl acetate) in a petri dish. Their reaction to CS was subsequently tested in a petri dish at different time intervals after conditioning. Trained larvae showed a significant preference or avoidance to CS when paired with US depending on the reinforcer used. The training was more efficient when larvae were given a choice between an area where CS-US was paired and an area with no CS (or another odor). In these conditions, the memory formed could be recalled at least 24 h after pairing with an aversive stimulus and only 5 min after pairing with an appetitive stimulus. This learning was specific to CS because trained larvae were able to discriminate CS from another odor that was present during the training but unrewarded. These results suggest that Lepidoptera larvae exhibit more behavioral plasticity than previously appreciated.