Spiking networks for Bayesian inference and choice

Systems neuroscience traditionally conceptualizes a population of spiking neurons as merely encoding the value of a stimulus. Yet, psychophysics has revealed that people take into account stimulus uncertainty when performing sensory or motor computations and do so in a nearly Bayes-optimal way. This suggests that neural populations do not encode just a single value but an entire probability distribution over the stimulus. Several such probabilistic codes have been proposed, including one that utilizes the structure of neural variability to enable simple neural implementations of probabilistic computations such as optimal cue integration. This approach provides a quantitative link between Bayes-optimal behaviors and specific neural operations. It allows for novel ways to evaluate probabilistic codes and for predictions for physiological population recordings.     

Automating the design of informative sequences of sensory stimuli

Adaptive stimulus design methods can potentially improve the efficiency of sensory neurophysiology experiments significantly; however, designing optimal stimulus sequences in real time remains a serious technical challenge. Here we describe two approximate methods for generating informative stimulus sequences: the first approach provides a fast method for scoring the informativeness of a batch of specific potential stimulus sequences, while the second method attempts to compute an optimal stimulus distribution from which the experimenter may easily sample. We apply these methods to single-neuron spike train data recorded from the auditory midbrain of zebra finches, and demonstrate that the resulting stimulus sequences do in fact provide more information about neuronal tuning in a shorter amount of time than do more standard experimental designs.     

The shaping of social perception by stimulus and knowledge cues to human animacy

Although robots are becoming an ever-growing presence in society, we do not hold the same expectations for robots as we do for humans, nor do we treat them the same. As such, the ability to recognize cues to human animacy is fundamental for guiding social interactions. We review literature that demonstrates cortical networks associated with person perception, action observation and mentalizing are sensitive to human animacy information. In addition, we show that most prior research has explored stimulus properties of artificial agents (humanness of appearance or motion), with less investigation into knowledge cues (whether an agent is believed to have human or artificial origins). Therefore, currently little is known about the relationship between stimulus and knowledge cues to human animacy in terms of cognitive and brain mechanisms. Using fMRI, an elaborate belief manipulation, and human and robot avatars, we found that knowledge cues to human animacy modulate engagement of person perception and mentalizing networks, while stimulus cues to human animacy had less impact on social brain networks. These findings demonstrate that self–other similarities are not only grounded in physical features but are also shaped by prior knowledge. More broadly, as artificial agents fulfil increasingly social roles, a challenge for roboticists will be to manage the impact of pre-conceived beliefs while optimizing human-like design.     

Transformation of a waiting schedule into a temporal regulation schedule (DRRD) by addition of external stimuli in the dog

Waiting schedules do not impose temporal regulation but condition the animal to give the operant response during a given time. At the end of the required delay, a positive discriminative stimulus is presented. The suspension of the response while the discriminative stimulus is being given suspension of the response while the discriminative stimulus is being given is accompanied by reinforcement. The transformation of a waiting schedule into a temporal regulation schedule is generally achieved by suppressing the external facilitating factors or by physically modifying them. Our study reveals that a similar transformation can be achieved in the dog by the addition of a further stimulus. This stimulus, which is physically exactly the same as the excitatory stimulus and which punctuates the waiting period, is randomly introduced into the temporal delay. The absence of reinforcement in response to the added stimulus should force the animal to regulate its behavior in time and the additional negative discriminative stimulus favours the expression of the active nature of the inhibation. The results show that subjects can differentiate their response durations according to stimuli that only differ according to temporal location. Thus this pattern resembles a DRRD schedule. The peak of responses at the time of the inhibition stimulus reveals considerable behavioral conflict : either the response must be maintained or the inhibition suppressed. The positive or negative resolution of this conflict reveals noteworthy aspects of the behavioural inhibition process.     

A comparison of responses and stimuli as time markers

A rat's behavior, as well as a stimulus, may be a time marker. But do they lead to similar performance? Eight rats were trained on a 20-s DRL procedure in which head-entry responses were time markers, i.e., each head-entry response indicated that food would not be delivered for 20 s. Concurrently, eight rats were trained on a control procedure in which light stimuli, yoked to the responses of a rat in the DRL procedure, were time markers, i.e., each light stimulus indicated that food would not be delivered for 20 s. A comparison of performance between the two groups showed a lower response rate in the DRL procedure than in the yoked control procedure. However, similar response patterns between the two groups were observed, suggesting that rats anticipated the food similarly with a stimulus or a response as the time marker.     

Visual Features Underlying Perceived Brightness as Revealed by Classification Images

Along with physical luminance, the perceived brightness is known to depend on the spatial structure of the stimulus. Often it is assumed that neural computation of the brightness is based on the analysis of luminance borders of the stimulus. However, this has not been tested directly. We introduce a new variant of the psychophysical reverse-correlation or classification image method to estimate and localize the physical features of the stimuli which correlate with the perceived brightness, using a brightness-matching task. We derive classification images for the illusory Craik-O''Brien-Cornsweet stimulus and a “real” uniform step stimulus. For both stimuli, classification images reveal a positive peak at the stimulus border, along with a negative peak at the background, but are flat at the center of the stimulus, suggesting that brightness is determined solely by the border information. Features in the perceptually completed area in the Craik-O''Brien-Cornsweet do not contribute to its brightness, nor could we see low-frequency boosting, which has been offered as an explanation for the illusion. Tuning of the classification image profiles changes remarkably little with stimulus size. This supports the idea that only certain spatial scales are used for computing the brightness of a surface.     

How Long Depends on How Fast—Perceived Flicker Dilates Subjective Duration

How do humans perceive the passage of time and the duration of events without a dedicated sensory system for timing? Previous studies have demonstrated that when a stimulus changes over time, its duration is subjectively dilated, indicating that duration judgments are based on the number of changes within an interval. In this study, we tested predictions derived from three different accounts describing the relation between a changing stimulus and its subjective duration as either based on (1) the objective rate of changes of the stimulus, (2) the perceived saliency of the changes, or (3) the neural energy expended in processing the stimulus. We used visual stimuli flickering at different frequencies (4–166 Hz) to study how the number of changes affects subjective duration. To this end, we assessed the subjective duration of these stimuli and measured participants'' behavioral flicker fusion threshold (the highest frequency perceived as flicker), as well as their threshold for a frequency-specific neural response to the flicker using EEG. We found that only consciously perceived flicker dilated perceived duration, such that a 2 s long stimulus flickering at 4 Hz was perceived as lasting as long as a 2.7 s steady stimulus. This effect was most pronounced at the slowest flicker frequencies, at which participants reported the most consistent flicker perception. Flicker frequencies higher than the flicker fusion threshold did not affect perceived duration at all, even if they evoked a significant frequency-specific neural response. In sum, our findings indicate that time perception in the peri-second range is driven by the subjective saliency of the stimulus'' temporal features rather than the objective rate of stimulus changes or the neural response to the changes.     

Sensitivity to stimulation, a component of the circadian rhythm in luminescence in gonyaulax

A new method for the stimulation of bioluminescence in the dinoflagellate Gonyaulax polyedra is described. With this technique, in which cells flow through a capillary coil, it is possible to graduate the intensity of the stimulus by varying the flow rate. In continuous darkness, the threshold stimulus for cells in the middle of the day phase is greater than that for cells in the middle of the night phase. Some evidence suggests heterogeneity of sensitivity to stimulation among either cells or individual luminescent sources within a cell. At stimulus intensities much above threshold, the luminescence of both day- and night-phase cells is proportional to the number of cells within the capillary coil. Night-phase cells emit about 14 times as much light as do day-phase cells in continuous darkness.     

Predation risk and reduced foraging activity in fish: experiments with parasitized and non-parasitized three-spined sticklebacks, Gasterosteus aculeatus L.

After varying periods of food deprivation the foraging behaviour of parasitized and non-parasitized sticklebacks was measured in both undisturbed and recently frightened fish. Parasitized sticklebacks forage significantly more actively and recover more quickly after a frightening stimulus than do control fish. They also react more quickly to food deprivation than do uninfected control fish. Seventy-two hours without food is sufficient to suppress the fright response in parasitized fish, and causes them to forage at the same rate as when undisturbed. Non-infected controls failed to forage successfully after a frightening stimulus, even when they had been without food for 96 h. Frightening stimuli can affect profoundly the normal foraging behaviour of hungry fish.     

Role of conditioned reinforcers in the initiation, maintenance and extinction of drug-seeking behavior.

The development of a secondary reinforcer as a result of associating a neutral stimulus (buzzer) with intravenous (IV) doses of morpine was studied in rats. Secondary reinforcement developed in the absence of physical dependence and followed the association of the stimulus with either response-contingent or non-contingent injections of morphine. Strength of the conditioned reinforcer, measured in terms of responding on a lever for the stimulus plus infusion of saline solution, was proportional to the unit dosage of morphine employed in pairings of buzzer and drug. When extinction of the lever-press response for IV morphine was conducted (by substituting saline for morphine solution) in the absence of the conditioned reinforcing stimulus, it was seen later that the stimulus could still elicit lever responses, until it too had been present for a sufficient interval of non-reinforced responding. Similarly, extinction of the response for morphine by blocking its action with naloxone in the absence of the stimulus did not eliminate the conditioned reinforcement. Another study showed that a passive, subcutaneous (SC) dose of morphine served to maintain lever-pressing on a contingency of buzzer plus saline infusion. Furthermore, the stimuli resulting from the presence of morphine (after a SC injection) were able to reinstate the lever-responding with only the buzzer-saline contingency when such responses had previously been extinguished. Moreover, it was shown that d-amphetamine could restore responding under the same conditions, and that morphine could also do so for rats in which the primary reinforcer had been d-amphetamine. It is suggested that animal data such as these show that procedures designed for the elimination of human drug-taking behavior must take into account secondary reinforcers as well as the primary reinforcer(s).     

Behavioral effects of neurohypophyseal peptides in healthy volunteers: 10 years of research

A short summary of behavioral studies on the effects of vasopressin and oxytocin published during the past decade is provided. Only studies using healthy volunteers as subjects were included. Among the studies reviewed, large differences exist with respect to design, procedure, treatment schedule and dose used. Results from the majority of the studies support that vasopressin and oxytocin affect central nervous functions in man after systemic administration. Since the hormonal influences do not appear to be consistently restricted to certain stages of stimulus processing but nonspecifically concern a great variety of cognitive functions, it is suggested that the influence of hypophyseal peptides on stimulus processing is mediated through an action on basic mechanisms involved in the general regulation of central nervous activation, i.e., on arousal systems that could also alter affective aspects of stimulus processing. The altogether moderate number of studies, so far, does not provide a sufficient data base justifying a clinical application of these peptides as nootropic treatments.     

A neural network model for the mechanism of feature-extraction

We propose a new multilayered neural network model which has the ability of rapid self-organization. This model is a modified version of the cognitron (Fukushima, 1975). It has modifiable inhibitory feedback connections, as well as conventional modifiable excitatory feedforward connections, between the cells of adjoining layers. If a feature-extracting cell in the network is excited by a stimulus which is already familiar to the network, the cell immediately feeds back inhibitory signals to its presynaptic cells in the preceding layer, which suppresses their response. On the other hand, the feature-extracting cell does not respond to an unfamiliar feature, and the responses from its presynaptic cells are therefore not suppressed because they do not receive any feedback inhibition. Modifiable synapses in the new network are reinforced in a way similar to those in the cognitron, and synaptic connections from cells yielding a large sustained output are reinforced. Since familiar stimulus features do not elicit a sustained response from the cells of the network, only circuits which detect novel stimulus features develop. The network therefore quickly acquires favorable pattern-selectivity by the mere repetitive presentation of set of learning patterns.     

Stimulus representation in SOP: II. An application to inhibition of delay

The componential extension of SOP accounts for conditioned response (CR) timing in Pavlovian conditioning by assuming that learning accrues with relative independence to stimulus elements that are differentially occasioned during the duration of the conditioned stimulus (CS). SOP, using a competitive learning rule and the assumption that temporal learning emerges via resolution of what is equivalent to an "AX+BX-" discrimination, predicts a progressive increase in the latency of the CR over training, or what Pavlov refer to as "inhibition of delay." Other componential models, which use noncompetitive learning rules, do not predict inhibition of delay. Either type of model makes the prediction indicated, independently of the length of the CS-unconditioned stimulus (US) interval. We report two experiments that demonstrated inhibition of delay when rabbits were trained with relatively long, but not with short, CS-US intervals. To account for this divergence, we assumed that the SOP stimulus trace involves two kinds of elements, some with a temporally distributed pattern of activity over the duration of the CS duration, and some with a randomly distributed pattern. This stimulus representation, not only allows for inhibition of delay with long but not short CS-US intervals, but in combination with SOP's performance rule deduces CR's with "Weber variability."     

Simulation of habituation to simple and multiple stimuli

Within the psychological literature there are a number of models that reproduce the defining properties of habituation to a single stimulus. However, most of them do not reproduce the phenomenon of dishabituation shown in empirical studies, consisting in the recovery of a stimulus previously habituated upon the appearance of a novel stimulus. The present work offers a model of habituation which, in addition to reproducing the basic properties of habituation to a stimulus, also does so when more than one stimulus is presented, and thus includes the dishabituation phenomenon. This model consists of two functions, one called "activation" and the other "availability", and is tested by means of simulation of the responses in the context of different stimulus patterns. The results of the simulation show a good qualitative fit to the empirical results on the phenomena of habituation, including dishabituation. In addition, the model is suitable for inclusion in associative models that reproduce classical conditioning, which will make it possible in the future to incorporate into these in a simple way the influence that the habituation of each stimulus may have on its association with other stimuli.     

Apis mellifera bees acquire long-term olfactory memories within the colony

Early studies indicate that Apis mellifera bees learn nectar odours within their colonies. This form of olfactory learning, however, has not been analysed by measuring well-quantifiable learning performances and the question remains whether it constitutes a 'robust' form of learning. Hence, we asked whether bees acquire long-term olfactory memories within the colony. To this end, we used the bee proboscis extension response. We found that within-the-nest bees do indeed associate the odour (as the conditioned stimulus) with the sugar (as the unconditioned stimulus) present in the incoming nectar, and that the distribution of scented nectar within the colony allows them to establish long-term olfactory memories. This finding is discussed in the context of efficient foraging.     

To Burst or Not to Burst?

It is well known that some neurons tend to fire packets of action potentials followed by periods of quiescence (bursts) while others within the same stage of sensory processing fire in a tonic manner. However, the respective computational advantages of bursting and tonic neurons for encoding time varying signals largely remain a mystery. Weakly electric fish use cutaneous electroreceptors to convey information about sensory stimuli and it has been shown that some electroreceptors exhibit bursting dynamics while others do not. In this study, we compare the neural coding capabilities of tonically firing and bursting electroreceptor model neurons using information theoretic measures. We find that both bursting and tonically firing model neurons efficiently transmit information about the stimulus. However, the decoding mechanisms that must be used for each differ greatly: a non-linear decoder would be required to extract all the available information transmitted by the bursting model neuron whereas a linear one might suffice for the tonically firing model neuron. Further investigations using stimulus reconstruction techniques reveal that, unlike the tonically firing model neuron, the bursting model neuron does not encode the detailed time course of the stimulus. A novel measure of feature detection reveals that the bursting neuron signals certain stimulus features. Finally, we show that feature extraction and stimulus estimation are mutually exclusive computations occurring in bursting and tonically firing model neurons, respectively. Our results therefore suggest that stimulus estimation and feature extraction might be parallel computations in certain sensory systems rather than being sequential as has been previously proposed.     

Set-related activity in the premotor cortex of rhesus monkeys: effect of triggering cues and relatively long delay intervals

"Set-related activity" has been defined as a significant alteration in neuronal discharge rate during an "instructed delay period," a period when a previously instructed movement is being withheld. It has been argued that set-related activity in the primate premotor cortex, or at least a significant proportion of it, reflects motor preparation. In most previous investigations, however, in which visual stimuli have triggered the movement and simultaneously indicated its target, set-related activity might reflect either the anticipation of or attention to the trigger stimulus. The present report shows that set-related activity is robust and can be directionally selective when trigger stimuli do not indicate the target and when a trigger stimulus is absent. Another feature of previous studies has been the relatively brief intervals between the instruction and trigger stimuli (typically 3 sec or less). In the present study, we were able to observe the activity of a small number of cells during longer delay periods. Set-related activity persists, although it becomes less consistent, for as much as 7.5 sec after an instruction stimulus. These results support the hypothesis that set-related activity reflects the preparation for specific limb movements.     

Set-Related Activity in the Premotor Cortex of Rhesus Monkeys: Effect of Triggering Cues and Relatively Long Delay Intervals

“Set-related activity” has been defined as a significant alteration in neuronal discharge rate during an “instructed delay period,” a period when a previously instructed movement is being withheld. It has been argued that set-related activity in the primate premotor cortex, or at least a significant proportion of it, reflects motor preparation. In most previous investigations, however, in which visual stimuli have triggered the movement and simultaneously indicated its target, set-related activity might reflect either the anticipation of or attention to the trigger stimulus. The present report shows that set-related activity is robust and can be directionally selective when trigger stimuli do not indicate the target and when a trigger stimulus is absent. Another feature of previous studies has been the relatively brief intervals between the instruction and trigger stimuli (typically 3 sec or less). In the present study, we were able to observe the activity of a small number of cells during longer delay periods. Set-related activity persists, although it becomes less consistent, for as much as 7.5 sec after an instruction stimulus. These results support the hypothesis that set-related activity reflects the preparation for specific limb movements.     

The role of dynamic stimulation pattern in the analysis of bistable intracellular networks

Bistable systems play an important role in the functioning of living cells. Depending on the strength of the necessary positive feedback one can distinguish between (irreversible) “one-way switch” or (reversible) “toggle-switch” type behavior. Besides the well- established steady-state properties, some important characteristics of bistable systems arise from an analysis of their dynamics. We demonstrate that a supercritical stimulus amplitude is not sufficient to move the system from the lower (off-state) to the higher branch (on-state) for either a step or a pulse input. A switching surface is identified for the system as a function of the initial condition, input pulse amplitude and duration (a supercritical signal). We introduce the concept of bounded autonomy for single level systems with a pulse input. Towards this end, we investigate and characterize the role of the duration of the stimulus. Furthermore we show, that a minimal signal power is also necessary to change the steady state of the bistable system. This limiting signal power is independent of the applied stimulus and is determined only by systems parameters. These results are relevant for the design of experiments, where it is often difficult to create a defined pattern for the stimulus. Furthermore, intracellular processes, like receptor internalization, do manipulate the level of stimulus such that level and duration of the stimulus is conducive to characteristic behavior.     

Fronto-Central Theta Oscillations Are Related to Oscillations in Saccadic Response Times (SRT): An EEG and Behavioral Data Analysis

The phase reset hypothesis states that the phase of an ongoing neural oscillation, reflecting periodic fluctuations in neural activity between states of high and low excitability, can be shifted by the occurrence of a sensory stimulus so that the phase value become highly constant across trials (Schroeder et al., 2008). From EEG/MEG studies it has been hypothesized that coupled oscillatory activity in primary sensory cortices regulates multi sensory processing (Senkowski et al. 2008). We follow up on a study in which evidence of phase reset was found using a purely behavioral paradigm by including also EEG measures. In this paradigm, presentation of an auditory accessory stimulus was followed by a visual target with a stimulus-onset asynchrony (SOA) across a range from 0 to 404 ms in steps of 4 ms. This fine-grained stimulus presentation allowed us to do a spectral analysis on the mean SRT as a function of the SOA, which revealed distinct peak spectral components within a frequency range of 6 to 11 Hz with a modus of 7 Hz. The EEG analysis showed that the auditory stimulus caused a phase reset in 7-Hz brain oscillations in a widespread set of channels. Moreover, there was a significant difference in the average phase at which the visual target stimulus appeared between slow and fast SRT trials. This effect was evident in three different analyses, and occurred primarily in frontal and central electrodes.