Effects of stimulus transformations on estimates of sensory neuron selectivity

Stimulus selectivity of sensory systems is often characterized by analyzing response-conditioned stimulus ensembles. However, in many cases these response-triggered stimulus sets have structure that is more complex than assumed. If not taken into account, when present it will bias the estimates of many simple statistics, and distort the estimated stimulus selectivity of a neural sensory system. We present an approach that mitigates these problems by modeling some of the response-conditioned stimulus structure as being generated by a set of transformations acting on a simple stimulus distribution. This approach corrects the estimates of key statistics and counters biases introduced by the transformations. In cases involving temporal spike jitter or spatial jitter of images, the main observed effects of transformations are blurring of the conditional mean and introduction of artefacts in the spectral decomposition of the conditional covariance matrix. We illustrate this approach by analyzing and correcting a set of model stimuli perturbed by temporal and spatial jitter. We apply the approach to neurophysiological data from the cricket cercal sensory system to correct the effects of temporal jitter. Action Editor: Matthew Wiener     

Observers exploit stochastic models of sensory change to help judge the passage of time

Sensory stimulation can systematically bias the perceived passage of time, but why and how this happens is mysterious. In this report, we provide evidence that such biases may ultimately derive from an innate and adaptive use of stochastically evolving dynamic stimuli to help refine estimates derived from internal timekeeping mechanisms. A simplified statistical model based on probabilistic expectations of stimulus change derived from the second-order temporal statistics of the natural environment makes three predictions. First, random noise-like stimuli whose statistics violate natural expectations should induce timing bias. Second, a previously unexplored obverse of this effect is that similar noise stimuli with natural statistics should reduce the variability of timing estimates. Finally, this reduction in variability should scale with the interval being timed, so as to preserve the overall Weber law of interval timing. All three predictions are borne out experimentally. Thus, in the context of our novel theoretical framework, these results suggest that observers routinely rely on sensory input to augment their sense of the passage of time, through a process of Bayesian inference based on expectations of change in the natural environment.     

Direction Specific Biases in Human Visual and Vestibular Heading Perception

Heading direction is determined from visual and vestibular cues. Both sensory modalities have been shown to have better direction discrimination for headings near straight ahead. Previous studies of visual heading estimation have not used the full range of stimuli, and vestibular heading estimation has not previously been reported. The current experiments measure human heading estimation in the horizontal plane to vestibular, visual, and spoken stimuli. The vestibular and visual tasks involved 16 cm of platform or visual motion. The spoken stimulus was a voice command speaking a heading angle. All conditions demonstrated direction dependent biases in perceived headings such that biases increased with headings further from the fore-aft axis. The bias was larger with the visual stimulus when compared with the vestibular stimulus in all 10 subjects. For the visual and vestibular tasks precision was best for headings near fore-aft. The spoken headings had the least bias, and the variation in precision was less dependent on direction. In a separate experiment when headings were limited to ±45°, the biases were much less, demonstrating the range of headings influences perception. There was a strong and highly significant correlation between the bias curves for visual and spoken stimuli in every subject. The correlation between visual-vestibular and vestibular-spoken biases were weaker but remained significant. The observed biases in both visual and vestibular heading perception qualitatively resembled predictions of a recent population vector decoder model (Gu et al., 2010) based on the known distribution of neuronal sensitivities.     

Paradoxical evidence integration in rapid decision processes

Decisions about noisy stimuli require evidence integration over time. Traditionally, evidence integration and decision making are described as a one-stage process: a decision is made when evidence for the presence of a stimulus crosses a threshold. Here, we show that one-stage models cannot explain psychophysical experiments on feature fusion, where two visual stimuli are presented in rapid succession. Paradoxically, the second stimulus biases decisions more strongly than the first one, contrary to predictions of one-stage models and intuition. We present a two-stage model where sensory information is integrated and buffered before it is fed into a drift diffusion process. The model is tested in a series of psychophysical experiments and explains both accuracy and reaction time distributions.     

The effect of stimulus discriminability on strategies for learning multiple temporal discriminations

The goal was to identify training conditions under which temporal intervals that are signaled by different stimuli are memorized (i.e., the temporal behavior is readily shown to be under stimulus control). Undergraduate students were trained on three signaled temporal discriminations using a peak procedure. The intervals were trained in either blocks of trials or with trials intermixed within the session, and then they were given a transfer test with intermixed trials. There were two levels of stimulus discriminability, defined by the similarity of the stimuli. Most participants memorized the intervals when the discriminations were intermixed within the session, or were easy, but not when the discriminations occurred in blocks and were difficult. In the transfer tests, those participants trained in the difficult discrimination that occurred in blocks of trials typically continued to perform as they did during the last-trained interval, regardless of the stimulus presented. These results are better explained by a memory retrieval than a memory storage account.     

Prospective timing under dual-task paradigms: attentional and contextual-change mechanisms

The effect of a concurrent memory task on prospective time estimates by human participants was investigated in two experiments. The objective was to isolate task effects from those of participant timing strategy (self-paced counting) and number of contextual changes during the temporal stimulus. Accordingly, self-paced counting was suppressed by requiring participants to perform a word-reading task during the temporal stimuli, while number of stimulus changes presented during temporal stimuli was controlled. Presence versus absence of the concurrent memory task was manipulated in Experiment 1, and instruction to focus on timing or to focus on memory was manipulated in Experiment 2. There was no significant effect of presence versus absence of the concurrent memory task on time estimates; however, time estimates were shorter when participants were instructed to focus on memory versus timing. In both experiments, time estimates were positively correlated with participants' estimates of the number of words presented during the interval, even though number of words presented was invariant. These findings were generally consistent with resource-allocation attentional accounts of concurrent task effects; however, support for a contextual-change model of timing was also obtained.     

Sequence matters – selective adaptation in electroantennographic response to binary odour mixtures by the Colorado potato beetle

Chemically mediated behaviour of insects is often strongly affected by mixtures of odour stimuli and their temporal characteristics. Both sensory transduction and central processing of odour mixtures can give rise to several different kinds of interaction, which can influence how individual components are perceived and processed. In particular, odour mixtures have been examined in model experiments as premixed binary mixtures in comparison with pure odour stimuli. Only in few experiments, the influence of the temporal structure of odour mixtures on odour perception has been taken into account. Natural odour stimuli often have a pulsed structure and may in general be superimposed on a background of irrelevant or interfering compounds, which can fluctuate with different frequencies, depending on their source. To achieve a better representation of these natural conditions, our odour mixing experiments apply a new kind of stimulation protocol: odours were not premixed but superimposed with a specific time pattern; one odour stimulus was presented as a longer persisting background and the second stimulus was a superimposed short test signal. To gain an overview of odour interaction patterns in the Colorado potato beetle by causing adaptation of one receptor population at naturally occurring levels of concentration and time intervals, electroantennographic recordings were made on excised antennae. A matrix of 12 stimulus compounds led to 132 pairs of compounds tested, each in the role of background and test stimulus. In 64 cases, the interaction was significantly different, when the role of background and stimulus was exchanged. Interaction patterns ranging from no interference (independence) to suppression were found and assigned to four clearly distinguishable types. We discuss that the observed effects of the presentation sequence in odour mixtures may contribute to the mechanisms of olfactory pattern recognition and olfactory contrast perception by insects.     

How Long Depends on How Fast—Perceived Flicker Dilates Subjective Duration

How do humans perceive the passage of time and the duration of events without a dedicated sensory system for timing? Previous studies have demonstrated that when a stimulus changes over time, its duration is subjectively dilated, indicating that duration judgments are based on the number of changes within an interval. In this study, we tested predictions derived from three different accounts describing the relation between a changing stimulus and its subjective duration as either based on (1) the objective rate of changes of the stimulus, (2) the perceived saliency of the changes, or (3) the neural energy expended in processing the stimulus. We used visual stimuli flickering at different frequencies (4–166 Hz) to study how the number of changes affects subjective duration. To this end, we assessed the subjective duration of these stimuli and measured participants'' behavioral flicker fusion threshold (the highest frequency perceived as flicker), as well as their threshold for a frequency-specific neural response to the flicker using EEG. We found that only consciously perceived flicker dilated perceived duration, such that a 2 s long stimulus flickering at 4 Hz was perceived as lasting as long as a 2.7 s steady stimulus. This effect was most pronounced at the slowest flicker frequencies, at which participants reported the most consistent flicker perception. Flicker frequencies higher than the flicker fusion threshold did not affect perceived duration at all, even if they evoked a significant frequency-specific neural response. In sum, our findings indicate that time perception in the peri-second range is driven by the subjective saliency of the stimulus'' temporal features rather than the objective rate of stimulus changes or the neural response to the changes.     

A century of generalization

We review data from both ethology and psychology about generalization, that is how animals respond to sets of stimuli including familiar and novel stimuli. Our main conclusion is that patterns of generalization are largely independent of systematic group (evidence is available for insects, fish, amphibians, reptiles, birds and mammals, including humans), behavioural context (feeding, drinking, courting, etc.), sensory modality (light, sound, etc.) and of whether reaction to stimuli is learned or genetically inherited. These universalities suggest that generalization originates from general properties of nervous systems, and that evolutionary strategies to cope with novelty and variability in stimulation may be limited. Two major shapes of the generalization gradient can be identified, corresponding to two types of stimulus dimensions. When changes in stimulation involve a rearrangement of a constant amount of stimulation on the sense organs, the generalization gradient peaks close to familiar stimuli, and peak responding is not much higher than responding to familiar stimuli. Contrary to what is often claimed, such gradients are better described by Gaussian curves than by exponentials. When the stimulus dimension involves a variation in the intensity of stimulation, the gradient is often monotonic, and responding to some novel stimuli is considerably stronger than responding to familiar stimuli. Lastly, when several or many familiar stimuli are close to each other predictable biases in responding occur, along all studied dimensions. We do not find differences between biases referred to as peak shift and biases referred to as supernormal stimulation. We conclude by discussing theoretical issues.     

An initial ‘snapshot’ of sensory information biases the likelihood and speed of subsequent changes of mind

We often need to rapidly change our mind about perceptual decisions in order to account for new information and correct mistakes. One fundamental, unresolved question is whether information processed prior to a decision being made (‘pre-decisional information’) has any influence on the likelihood and speed with which that decision is reversed. We investigated this using a luminance discrimination task in which participants indicated which of two flickering greyscale squares was brightest. Following an initial decision, the stimuli briefly remained on screen, and participants could change their response. Using psychophysical reverse correlation, we examined how moment-to-moment fluctuations in stimulus luminance affected participants’ decisions. This revealed that the strength of even the very earliest (pre-decisional) evidence was associated with the likelihood and speed of later changes of mind. To account for this effect, we propose an extended diffusion model in which an initial ‘snapshot’ of sensory information biases ongoing evidence accumulation.     

Recalibration of the Multisensory Temporal Window of Integration Results from Changing Task Demands

The notion of the temporal window of integration, when applied in a multisensory context, refers to the breadth of the interval across which the brain perceives two stimuli from different sensory modalities as synchronous. It maintains a unitary perception of multisensory events despite physical and biophysical timing differences between the senses. The boundaries of the window can be influenced by attention and past sensory experience. Here we examined whether task demands could also influence the multisensory temporal window of integration. We varied the stimulus onset asynchrony between simple, short-lasting auditory and visual stimuli while participants performed two tasks in separate blocks: a temporal order judgment task that required the discrimination of subtle auditory-visual asynchronies, and a reaction time task to the first incoming stimulus irrespective of its sensory modality. We defined the temporal window of integration as the range of stimulus onset asynchronies where performance was below 75% in the temporal order judgment task, as well as the range of stimulus onset asynchronies where responses showed multisensory facilitation (race model violation) in the reaction time task. In 5 of 11 participants, we observed audio-visual stimulus onset asynchronies where reaction time was significantly accelerated (indicating successful integration in this task) while performance was accurate in the temporal order judgment task (indicating successful segregation in that task). This dissociation suggests that in some participants, the boundaries of the temporal window of integration can adaptively recalibrate in order to optimize performance according to specific task demands.     

The vestibular system implements a linear-nonlinear transformation in order to encode self-motion

Although it is well established that the neural code representing the world changes at each stage of a sensory pathway, the transformations that mediate these changes are not well understood. Here we show that self-motion (i.e. vestibular) sensory information encoded by VIIIth nerve afferents is integrated nonlinearly by post-synaptic central vestibular neurons. This response nonlinearity was characterized by a strong (～50%) attenuation in neuronal sensitivity to low frequency stimuli when presented concurrently with high frequency stimuli. Using computational methods, we further demonstrate that a static boosting nonlinearity in the input-output relationship of central vestibular neurons accounts for this unexpected result. Specifically, when low and high frequency stimuli are presented concurrently, this boosting nonlinearity causes an intensity-dependent bias in the output firing rate, thereby attenuating neuronal sensitivities. We suggest that nonlinear integration of afferent input extends the coding range of central vestibular neurons and enables them to better extract the high frequency features of self-motion when embedded with low frequency motion during natural movements. These findings challenge the traditional notion that the vestibular system uses a linear rate code to transmit information and have important consequences for understanding how the representation of sensory information changes across sensory pathways.     

Human preferences for symmetry: subjective experience, cognitive conflict and cortical brain activity

This study examines the links between human perceptions, cognitive biases and neural processing of symmetrical stimuli. While preferences for symmetry have largely been examined in the context of disorders such as obsessive-compulsive disorder and autism spectrum disorders, we examine various these phenomena in non-clinical subjects and suggest that such preferences are distributed throughout the typical population as part of our cognitive and neural architecture. In Experiment 1, 82 young adults reported on the frequency of their obsessive-compulsive spectrum behaviors. Subjects also performed an emotional Stroop or variant of an Implicit Association Task (the OC-CIT) developed to assess cognitive biases for symmetry. Data not only reveal that subjects evidence a cognitive conflict when asked to match images of positive affect with asymmetrical stimuli, and disgust with symmetry, but also that their slowed reaction times when asked to do so were predicted by reports of OC behavior, particularly checking behavior. In Experiment 2, 26 participants were administered an oddball Event-Related Potential task specifically designed to assess sensitivity to symmetry as well as the OC-CIT. These data revealed that reaction times on the OC-CIT were strongly predicted by frontal electrode sites indicating faster processing of an asymmetrical stimulus (unparallel lines) relative to a symmetrical stimulus (parallel lines). The results point to an overall cognitive bias linking disgust with asymmetry and suggest that such cognitive biases are reflected in neural responses to symmetrical/asymmetrical stimuli.     

The Effect of Slow Electrical Stimuli to Achieve Learning in Cultured Networks of Rat Cortical Neurons

Learning, or more generally, plasticity may be studied using cultured networks of rat cortical neurons on multi electrode arrays. Several protocols have been proposed to affect connectivity in such networks. One of these protocols, proposed by Shahaf and Marom, aimed to train the input-output relationship of a selected connection in a network using slow electrical stimuli. Although the results were quite promising, the experiments appeared difficult to repeat and the training protocol did not serve as a basis for wider investigation yet. Here, we repeated their protocol, and compared our ‘learning curves’ to the original results. Although in some experiments the protocol did not seem to work, we found that on average, the protocol showed a significantly improved stimulus response indeed. Furthermore, the protocol always induced functional connectivity changes that were much larger than changes that occurred after a comparable period of random or no stimulation. Finally, our data shows that stimulation at a fixed electrode induces functional connectivity changes of similar magnitude as stimulation through randomly varied sites; both larger than spontaneous connectivity fluctuations. We concluded that slow electrical stimulation always induced functional connectivity changes, although uncontrolled. The magnitude of change increased when we applied the adaptive (closed-loop) training protocol. We hypothesize that networks develop an equilibrium between connectivity and activity. Induced connectivity changes depend on the combination of applied stimulus and initial connectivity. Plain stimuli may drive networks to the nearest equilibrium that accommodates this input, whereas adaptive stimulation may direct the space for exploration and force networks to a new balance, at a larger distance from the initial state.     

Set-size effects for spatial frequency change and discrimination in multiple targets

In visual search tasks with a near-threshold target amongst distracters, log detection thresholds rise in proportion to the log of the number of stimuli. Previous research has shown a very steep slope for this set-size effect where the target is a change in spatial frequency (SF) across an ISI, suggesting a low-level explanation for 'change blindness (Wright et al., 2000). Here, we analyse stimulus and task variables in order to determine the contributions of stimulus detection and attention processes. Stimuli consisted of two 150 ms frames each containing 1 to 4 Gabor targets, with an ISI of 250 ms. In a 2AFC detection task with uniform distracters, slopes of 0.23-0.52 were found, in line with visual search results. 2AFC SF discrimination tasks gave slopes of 0.68, 0.69 with homogeneous distracters and 0.76-0.96 with inhomogeneous distracters, consistent with averaging of stimuli within a frame. If the distracters were also made to change across ISI, averaging was impossible, and focal attention was required to solve the discrimination. This always gave set-size slopes > 1. It is concluded that, under conditions where a stimulus array can be analysed globally, change detection performance is limited by signal detection mechanisms, rather than limited capacity attention or memory mechanisms. However, where this is prevented, for example by changing more than one item, limitations due to attention or memory produce an even steeper set-size effect.     

Opposite Distortions in Interval Timing Perception for Visual and Auditory Stimuli with Temporal Modulations

When an object is presented visually and moves or flickers, the perception of its duration tends to be overestimated. Such an overestimation is called time dilation. Perceived time can also be distorted when a stimulus is presented aurally as an auditory flutter, but the mechanisms and their relationship to visual processing remains unclear. In the present study, we measured interval timing perception while modulating the temporal characteristics of visual and auditory stimuli, and investigated whether the interval times of visually and aurally presented objects shared a common mechanism. In these experiments, participants compared the durations of flickering or fluttering stimuli to standard stimuli, which were presented continuously. Perceived durations for auditory flutters were underestimated, while perceived durations of visual flickers were overestimated. When auditory flutters and visual flickers were presented simultaneously, these distortion effects were cancelled out. When auditory flutters were presented with a constantly presented visual stimulus, the interval timing perception of the visual stimulus was affected by the auditory flutters. These results indicate that interval timing perception is governed by independent mechanisms for visual and auditory processing, and that there are some interactions between the two processing systems.     

Attentional weighting: a possible account of visual field asymmetries in visual search?

Several previous visual search studies measuring reaction times have demonstrated scanning biases across the visual field (i.e. a tendency to begin a serial search in a particular region of space). In the present study, we measured visual discrimination thresholds for a target presented amongst distractors using displays that were short enough to greatly reduce the potential for serial (i.e. scanning) search. For both a motion and orientation task, subjects' performance was significantly better when the target appeared in the inferior, as compared to the superior, visual field (no differences were observed between left and right visual fields). These findings suggest that subjects may divide attention unevenly across the visual field when searching for a target amongst distractors, a phenomenon we refer to as 'attentional weighting'. To rule out the possibility that these visual field asymmetries were sensory in nature, thresholds were also measured for conditions in which subjects' attention was directed to the location of the target stimulus, either because it was presented alone in the display or because a spatial cue directed subjects' attention to the location of that target presented amongst distractors. Under these conditions, visual field asymmetries were smaller (or non-existent), suggesting that sensory factors (such as crowding) are unlikely to account for our results. In addition, analyses of set-size effects (obtained by comparing thresholds for a single target vs. the target presented amongst distractors) could be accounted for by an unlimited capacity model, suggesting that multiple stimuli can be processed simultaneously without any limitations at an early stage of sensory processing. Taken together, these findings suggest the possible existence of biases in attentional weighting at a late stage of processing. The bias appears to favor the inferior visual field, which may arise from the fact that there is more ecologically-relevant information in this region of space.     

Disentangling the nature of the nicotine stimulus

Learning involving interoceptive stimuli likely plays an important role in many diseases and psychopathologies. Within this area, there has been extensive research investigating the interoceptive stimulus effects of abused drugs. In this pursuit, behavioral pharmacologists have taken advantage of what is known about learning processes and adapted the techniques to investigate the behavioral and receptor mechanisms of drug stimuli. Of particular interest is the nicotine stimulus and the use of the two-lever operant drug discrimination task and the Pavlovian drug discriminated goal-tracking task. There is strong concordance between the two methods when using "standard" testing protocols that minimize learning on test days. For example, ABT-418, nornicotine, and varenicline all fully evoked nicotine-appropriate responding. Notably, research from our laboratory with the discriminated goal-tracking task has used an alternative testing protocol. This protocol assesses stimulus substitution based on how well extinction learning using a non-nicotine ligand transfers back to the nicotine stimulus. These findings challenge conclusions based on more "standard" testing procedures (e.g., ABT-418 is not nicotine-like). As a starting point, we propose Thurstone scaling as a quantitative method for more precisely comparing transfer of extinction across doses, experiments, and investigators. We close with a discussion of future research directions and potential implications of the research for understanding interoceptive stimuli.     

Searching for Optimal Sensory Signals: Iterative Stimulus Reconstruction in Closed-Loop Experiments

Shaped by evolutionary processes, sensory systems often represent behaviorally relevant stimuli with higher fidelity than other stimuli. The stimulus dependence of neural reliability could therefore provide an important clue in a search for relevant sensory signals. We explore this relation and introduce a novel iterative algorithm that allows one to find stimuli that are reliably represented by the sensory system under study. To assess the quality of a neural representation, we use stimulus reconstruction methods. The algorithm starts with the presentation of an initial stimulus (e.g. white noise). The evoked spike train is recorded and used to reconstruct the stimulus online. Within a closed-loop setup, this reconstruction is then played back to the sensory system. Iterating this procedure, the newly generated stimuli can be better and better reconstructed. We demonstrate the feasibility of this method by applying it to auditory receptor neurons in locusts. Our data show that the optimal stimuli often exhibit pronounced sub-threshold periods that are interrupted by short, yet intense pulses. Similar results are obtained for simple model neurons and suggest that these stimuli are encoded with high reliability by a large class of neurons.