How Long Depends on How Fast—Perceived Flicker Dilates Subjective Duration

How do humans perceive the passage of time and the duration of events without a dedicated sensory system for timing? Previous studies have demonstrated that when a stimulus changes over time, its duration is subjectively dilated, indicating that duration judgments are based on the number of changes within an interval. In this study, we tested predictions derived from three different accounts describing the relation between a changing stimulus and its subjective duration as either based on (1) the objective rate of changes of the stimulus, (2) the perceived saliency of the changes, or (3) the neural energy expended in processing the stimulus. We used visual stimuli flickering at different frequencies (4–166 Hz) to study how the number of changes affects subjective duration. To this end, we assessed the subjective duration of these stimuli and measured participants'' behavioral flicker fusion threshold (the highest frequency perceived as flicker), as well as their threshold for a frequency-specific neural response to the flicker using EEG. We found that only consciously perceived flicker dilated perceived duration, such that a 2 s long stimulus flickering at 4 Hz was perceived as lasting as long as a 2.7 s steady stimulus. This effect was most pronounced at the slowest flicker frequencies, at which participants reported the most consistent flicker perception. Flicker frequencies higher than the flicker fusion threshold did not affect perceived duration at all, even if they evoked a significant frequency-specific neural response. In sum, our findings indicate that time perception in the peri-second range is driven by the subjective saliency of the stimulus'' temporal features rather than the objective rate of stimulus changes or the neural response to the changes.     

Distortions of subjective time perception within and across senses

Background

The ability to estimate the passage of time is of fundamental importance for perceptual and cognitive processes. One experience of time is the perception of duration, which is not isomorphic to physical duration and can be distorted by a number of factors. Yet, the critical features generating these perceptual shifts in subjective duration are not understood.

Methodology/Findings

We used prospective duration judgments within and across sensory modalities to examine the effect of stimulus predictability and feature change on the perception of duration. First, we found robust distortions of perceived duration in auditory, visual and auditory-visual presentations despite the predictability of the feature changes in the stimuli. For example, a looming disc embedded in a series of steady discs led to time dilation, whereas a steady disc embedded in a series of looming discs led to time compression. Second, we addressed whether visual (auditory) inputs could alter the perception of duration of auditory (visual) inputs. When participants were presented with incongruent audio-visual stimuli, the perceived duration of auditory events could be shortened or lengthened by the presence of conflicting visual information; however, the perceived duration of visual events was seldom distorted by the presence of auditory information and was never perceived shorter than their actual durations.

Conclusions/Significance

These results support the existence of multisensory interactions in the perception of duration and, importantly, suggest that vision can modify auditory temporal perception in a pure timing task. Insofar as distortions in subjective duration can neither be accounted for by the unpredictability of an auditory, visual or auditory-visual event, we propose that it is the intrinsic features of the stimulus that critically affect subjective time distortions.     

Human time perception and its illusions

Why does a clock sometimes appear stopped? Is it possible to perceive the world in slow motion during a car accident? Can action and effect be reversed? Time perception is surprisingly prone to measurable distortions and illusions. The past few years have introduced remarkable progress in identifying and quantifying temporal illusions of duration, temporal order, and simultaneity. For example, perceived durations can be distorted by saccades, by an oddball in a sequence, or by stimulus complexity or magnitude. Temporal order judgments of actions and sensations can be reversed by the exposure to delayed motor consequences, and simultaneity judgments can be manipulated by repeated exposure to nonsimultaneous stimuli. The confederacy of recently discovered illusions points to the underlying neural mechanisms of time perception.     

Relativistic compression and expansion of experiential time in the left and right space

Time, space and numbers are closely linked in the physical world. However, the relativistic-like effects on time perception of spatial and magnitude factors remain poorly investigated. Here we wanted to investigate whether duration judgments of digit visual stimuli are biased depending on the side of space where the stimuli are presented and on the magnitude of the stimulus itself. Different groups of healthy subjects performed duration judgment tasks on various types of visual stimuli. In the first two experiments visual stimuli were constituted by digit pairs (1 and 9), presented in the centre of the screen or in the right and left space. In a third experiment visual stimuli were constituted by black circles. The duration of the reference stimulus was fixed at 300 ms. Subjects had to indicate the relative duration of the test stimulus compared with the reference one. The main results showed that, regardless of digit magnitude, duration of stimuli presented in the left hemispace is underestimated and that of stimuli presented in the right hemispace is overestimated. On the other hand, in midline position, duration judgments are affected by the numerical magnitude of the presented stimulus, with time underestimation of stimuli of low magnitude and time overestimation of stimuli of high magnitude. These results argue for the presence of strict interactions between space, time and magnitude representation on the human brain.     

Attentional entrainment and perceived event duration

This study considered the contribution of dynamic attending theory (DAT) and attentional entrainment to systematic distortions in perceived event duration. Three experiments were conducted using an auditory oddball paradigm, in which listeners judged the duration of a deviant (oddball) stimulus embedded within a series of identical (standard) stimuli. To test for a role of attentional entrainment in perceived oddball duration, oddballs were presented at either temporally expected (on time) or unexpectedly early or late time points relative to extrapolation of the context rhythm. Consistent with involvement of attentional entrainment in perceived duration, duration judgements about the oddball were least distorted when the oddball occurred on time with respect to the entrained rhythm, whereas durations of early and late oddballs were perceived to be shorter and longer, respectively. This pattern of results was independent of the absolute time interval preceding the oddball. Moreover, as expected, an irregularly timed sequence context weakened observed differences between oddballs with on-time and late onsets. Combined with other recent work on the role of temporal preparation in duration distortions, the present findings allot at least a portion of the oddball effect to increased attention to events that are more expected, rather than on their unexpected nature per se.     

Spatially localized distortions of event time

A fundamental question about the perception of time is whether the neural mechanisms underlying temporal judgements are universal and centralized in the brain or modality specific and distributed. Time perception has traditionally been thought to be entirely dissociated from spatial vision. Here we show that the apparent duration of a dynamic stimulus can be manipulated in a local region of visual space by adapting to oscillatory motion or flicker. This implicates spatially localized temporal mechanisms in duration perception. We do not see concomitant changes in the time of onset or offset of the test patterns, demonstrating a direct local effect on duration perception rather than an indirect effect on the time course of neural processing. The effects of adaptation on duration perception can also be dissociated from motion or flicker perception per se. Although 20 Hz adaptation reduces both the apparent temporal frequency and duration of a 10 Hz test stimulus, 5 Hz adaptation increases apparent temporal frequency but has little effect on duration perception. We conclude that there is a peripheral, spatially localized, essentially visual component involved in sensing the duration of visual events.     

Subjective Duration Distortions Mirror Neural Repetition Suppression

Background

Subjective duration is strongly influenced by repetition and novelty, such that an oddball stimulus in a stream of repeated stimuli appears to last longer in duration in comparison. We hypothesize that this duration illusion, called the temporal oddball effect, is a result of the difference in expectation between the oddball and the repeated stimuli. Specifically, we conjecture that the repeated stimuli contract in duration as a result of increased predictability; these duration contractions, we suggest, result from decreased neural response amplitude with repetition, known as repetition suppression.

Methodology/Principal Findings

Participants viewed trials consisting of lines presented at a particular orientation (standard stimuli) followed by a line presented at a different orientation (oddball stimulus). We found that the size of the oddball effect correlates with the number of repetitions of the standard stimulus as well as the amount of deviance from the oddball stimulus; both of these results are consistent with a repetition suppression hypothesis. Further, we find that the temporal oddball effect is sensitive to experimental context – that is, the size of the oddball effect for a particular experimental trial is influenced by the range of duration distortions seen in preceding trials.

Conclusions/Significance

Our data suggest that the repetition-related duration contractions causing the oddball effect are a result of neural repetition suppression. More generally, subjective duration may reflect the prediction error associated with a stimulus and, consequently, the efficiency of encoding that stimulus. Additionally, we emphasize that experimental context effects need to be taken into consideration when designing duration-related tasks.     

Timing Rhythms: Perceived Duration Increases with a Predictable Temporal Structure of Short Interval Fillers

Variations in the temporal structure of an interval can lead to remarkable differences in perceived duration. For example, it has previously been shown that isochronous intervals, that is, intervals filled with temporally regular stimuli, are perceived to last longer than intervals left empty or filled with randomly timed stimuli. Characterizing the extent of such distortions is crucial to understanding how duration perception works. One account to explain effects of temporal structure is a non-linear accumulator-counter mechanism reset at the beginning of every subinterval. An alternative explanation based on entrainment to regular stimulation posits that the neural response to each filler stimulus in an isochronous sequence is amplified and a higher neural response may lead to an overestimation of duration. If entrainment is the key that generates response amplification and the distortions in perceived duration, then any form of predictability in the temporal structure of interval fillers should lead to the perception of an interval that lasts longer than a randomly filled one. The present experiments confirm that intervals filled with fully predictable rhythmically grouped stimuli lead to longer perceived duration than anisochronous intervals. No general over- or underestimation is registered for rhythmically grouped compared to isochronous intervals. However, we find that the number of stimuli in each group composing the rhythm also influences perceived duration. Implications of these findings for a non-linear clock model as well as a neural response magnitude account of perceived duration are discussed.     

Foraging strategy switching in an antlion larva

Prepulse inhibition (PPI) refers to the process wherein startle responses to salient stimuli (e.g., startling sound pulses) are attenuated by the presentation of another stimulus (e.g., a brief pre-pulse) immediately before the startling stimulus. Accordingly, deficits in PPI reflect atypical sensorimotor gating that is linked to neurobehavioral systems underlying responsivity to emotionally evocative cues. Little is known about the effects of changes in visual contextual information in PPI among humans. In this study, the effects of introducing unexpected changes in the visual scenes presented on a computer monitor on the human auditory startle response and PPI were assessed in young adults. Based on our animal data showing that unexpected transitions from a dark to a light environment reduce the startle response and PPI in rats after the illumination transition, it was hypothesized that novel changes in visual scenes would produce similar effects in humans. Results show that PPI decreased when elements were added to or removed from visual scenes, and that this effect declined after repeated presentations of the modified scene, supporting the interpretation that the PPI reduction was due to novel information being processed. These findings are the first to demonstrate that novel visual stimuli can impair sensorimotor gating of auditory stimuli in humans.     

Neural correlates of visual aesthetics--beauty as the coalescence of stimulus and internal state

How do external stimuli and our internal state coalesce to create the distinctive aesthetic pleasures that give vibrance to human experience? Neuroaesthetics has so far focused on the neural correlates of observing beautiful stimuli compared to neutral or ugly stimuli, or on neural correlates of judging for beauty as opposed to other judgments. Our group questioned whether this approach is sufficient. In our view, a brain region that assesses beauty should show beauty-level-dependent activation during the beauty judgment task, but not during other, unrelated tasks. We therefore performed an fMRI experiment in which subjects judged visual textures for beauty, naturalness and roughness. Our focus was on finding brain activation related to the rated beauty level of the stimuli, which would take place exclusively during the beauty judgment. An initial whole-brain analysis did not reveal such interactions, yet a number of the regions showing main effects of the judgment task or the beauty level of stimuli were selectively sensitive to beauty level during the beauty task. Of the regions that were more active during beauty judgments than roughness judgments, the frontomedian cortex and the amygdala demonstrated the hypothesized interaction effect, while the posterior cingulate cortex did not. The latter region, which only showed a task effect, may play a supporting role in beauty assessments, such as attending to one''s internal state rather than the external world. Most of the regions showing interaction effects of judgment and beauty level correspond to regions that have previously been implicated in aesthetics using different stimulus classes, but based on either task or beauty effects alone. The fact that we have now shown that task-stimulus interactions are also present during the aesthetic judgment of visual textures implies that these areas form a network that is specifically devoted to aesthetic assessment, irrespective of the stimulus type.     

Characteristics of Human Luminance Discrimination and Modeling a Neural Network Based on the Response Properties of the Visual Cortex

Reaction time (RT) and error rate that depend on stimulus duration were measured in a luminance-discrimination reaction time task. Two patches of light with different luminance were presented to participants for ‘short’ (150 ms) or ‘long’ (1 s) period on each trial. When the stimulus duration was ‘short’, the participants responded more rapidly with poorer discrimination performance than they did in the longer duration. The results suggested that different sensory responses in the visual cortices were responsible for the dependence of response speed and accuracy on the stimulus duration during the luminance-discrimination reaction time task. It was shown that the simple winner-take-all-type neural network model receiving transient and sustained stimulus information from the primary visual cortex successfully reproduced RT distributions for correct responses and error rates. Moreover, temporal spike sequences obtained from the model network closely resembled to the neural activity in the monkey prefrontal or parietal area during other visual decision tasks such as motion discrimination and oddball detection tasks.     

Visible Persistence of Single-Transient Random Dot Patterns: Spatial Parameters Affect the Duration of Fading Percepts

Visible persistence refers to the continuation of visual perception after the physical termination of a stimulus. We studied an extreme case of visible persistence by presenting two matrices of randomly distributed black and white pixels in succession. On the transition from one matrix to the second, the luminance polarity of all pixels within a disk- or annulus-shaped area reversed, physically creating a single second-order transient signal. This transient signal produces the percept of a disk or an annulus with an abrupt onset and a gradual offset. To study the nature of this fading percept we varied spatial parameters, such as the inner and the outer diameter of annuli (Experiment I) and the radius and eccentricity of disks (Experiment III), and measured the duration of visible persistence by having subjects adjust the synchrony of the onset of a reference stimulus with the onset or the offset of the fading percept. We validated this method by comparing two modalities of the reference stimuli (Experiment I) and by comparing the judgments of fading percepts with the judgments of stimuli that actually fade in luminance contrast (Experiment II). The results show that (i) irrespective of the reference modality, participants are able to precisely judge the on- and the offsets of the fading percepts, (ii) auditory reference stimuli lead to higher visible persistence durations than visual ones, (iii) visible persistence duration increases with the thickness of annuli and the diameter of disks, but decreases with the diameter of annuli, irrespective of stimulus eccentricity. These effects cannot be explained by stimulus energy, which suggests that more complex processing mechanisms are involved. Seemingly contradictory effects of disk and annulus diameter can be unified by assuming an abstract filling-in mechanism that speeds up with the strength of the edge signal and takes more time the larger the stimulus area is.     

Sound improves distinction of low intensities of light in the visual cortex of a rabbit

Electrodes were implanted into cranium above the primary visual cortex of four rabbits (Orictolagus cuniculus). At the first stage, visual evoked potentials (VEPs) were recorded in response to substitution of threshold visual stimuli (0.28 and 0.31 cd/m2). Then the sound (2000 Hz, 84 dB, duration 40 ms) was added simultaneously to every visual stimulus. Single sounds (without visual stimuli) did not produce a VEP-response. It was found that the amplitude ofVEP component N1 (85-110 ms) in response to complex stimuli (visual and sound) increased 1.6 times as compared to "simple" visual stimulation. At the second stage, paired substitutions of 8 different visual stimuli (range 0.38-20.2 cd/m2) by each other were performed. Sensory spaces of intensity were reconstructed on the basis of factor analysis. Sensory spaces of complexes were reconstructed in a similar way for simultaneous visual and sound stimulation. Comparison of vectors representing the stimuli in the spaces showed that the addition of a sound led to a 1.4-fold expansion of the space occupied by smaller intensities (0.28; 1.02; 3.05; 6.35 cd/m2). Also, the addition of the sound led to an arrangement of intensities in an ascending order. At the same time, the sound 1.33-times narrowed the space of larger intensities (8.48; 13.7; 16.8; 20.2 cd/m2). It is suggested that the addition of a sound improves a distinction of smaller intensities and impairs a dis- tinction of larger intensities. Sensory spaces revealed by complex stimuli were two-dimensional. This fact can be a consequence of integration of sound and light in a unified complex at simultaneous stimulation.     

Conscious awareness of flicker in humans involves frontal and parietal cortex

Even when confined to the same spatial location, flickering and steady light evoke very different conscious experiences because of their distinct temporal patterns. The neural basis of such differences in subjective experience remains uncertain . Here, we used functional MRI in humans to examine the neural structures involved in awareness of flicker. Participants viewed a single point source of light that flickered at the critical flicker fusion (CFF) threshold, where the same stimulus is sometimes perceived as flickering and sometimes as steady (fused) . We were thus able to compare brain activity for conscious percepts that differed qualitatively (flickering or fused) but were evoked by identical physical stimuli. Greater brain activation was observed on flicker (versus fused) trials in regions of frontal and parietal cortex previously associated with visual awareness in tasks that did not require detection of temporal patterns . In contrast, greater activation was observed on fused (versus flicker) trials in occipital extrastriate cortex. Our findings indicate that activity of higher-level cortical areas is important for awareness of temporally distinct visual events in the context of a nonspatial task, and they thus suggest that frontal and parietal regions may play a general role in visual awareness.     

The Impact of Attention on Judgments of Frequency and Duration

Previous studies that examined human judgments of frequency and duration found an asymmetrical relationship: While frequency judgments were quite accurate and independent of stimulus duration, duration judgments were highly dependent upon stimulus frequency. A potential explanation for these findings is that the asymmetry is moderated by the amount of attention directed to the stimuli. In the current experiment, participants'' attention was manipulated in two ways: (a) intrinsically, by varying the type and arousal potential of the stimuli (names, low-arousal and high-arousal pictures), and (b) extrinsically, by varying the physical effort participants expended during the stimulus presentation (by lifting a dumbbell vs. relaxing the arm). Participants processed stimuli with varying presentation frequencies and durations and were subsequently asked to estimate the frequency and duration of each stimulus. Sensitivity to duration increased for pictures in general, especially when processed under physical effort. A large effect of stimulus frequency on duration judgments was obtained for all experimental conditions, but a similar large effect of presentation duration on frequency judgments emerged only in the conditions that could be expected to draw high amounts of attention to the stimuli: when pictures were judged under high physical effort. Almost no difference in the mutual impact of frequency and duration was obtained for low-arousal or high-arousal pictures. The mechanisms underlying the simultaneous processing of frequency and duration are discussed with respect to existing models derived from animal research. Options for the extension of such models to human processing of frequency and duration are suggested.     

Alternation of Sound Location Induces Visual Motion Perception of a Static Object

Background

Audition provides important cues with regard to stimulus motion although vision may provide the most salient information. It has been reported that a sound of fixed intensity tends to be judged as decreasing in intensity after adaptation to looming visual stimuli or as increasing in intensity after adaptation to receding visual stimuli. This audiovisual interaction in motion aftereffects indicates that there are multimodal contributions to motion perception at early levels of sensory processing. However, there has been no report that sounds can induce the perception of visual motion.

Methodology/Principal Findings

A visual stimulus blinking at a fixed location was perceived to be moving laterally when the flash onset was synchronized to an alternating left-right sound source. This illusory visual motion was strengthened with an increasing retinal eccentricity (2.5 deg to 20 deg) and occurred more frequently when the onsets of the audio and visual stimuli were synchronized.

Conclusions/Significance

We clearly demonstrated that the alternation of sound location induces illusory visual motion when vision cannot provide accurate spatial information. The present findings strongly suggest that the neural representations of auditory and visual motion processing can bias each other, which yields the best estimates of external events in a complementary manner.     

Shortening of subjective visual intervals followed by repetitive stimulation

Our previous research demonstrated that repetitive tone stimulation shortened the perceived duration of the preceding auditory time interval. In this study, we examined whether repetitive visual stimulation influences the perception of preceding visual time intervals. Results showed that a time interval followed by a high-frequency visual flicker was perceived as shorter than that followed by a low-frequency visual flicker. The perceived duration decreased as the frequency of the visual flicker increased. The visual flicker presented in one hemifield shortened the apparent time interval in the other hemifield. A final experiment showed that repetitive tone stimulation also shortened the perceived duration of preceding visual time intervals. We concluded that visual flicker shortened the perceived duration of preceding visual time intervals in the same way as repetitive auditory stimulation shortened the subjective duration of preceding tones.     

Audiovisual Delay as a Novel Cue to Visual Distance

For audiovisual sensory events, sound arrives with a delay relative to light that increases with event distance. It is unknown, however, whether humans can use these ubiquitous sound delays as an information source for distance computation. Here, we tested the hypothesis that audiovisual delays can both bias and improve human perceptual distance discrimination, such that visual stimuli paired with auditory delays are perceived as more distant and are thereby an ordinal distance cue. In two experiments, participants judged the relative distance of two repetitively displayed three-dimensional dot clusters, both presented with sounds of varying delays. In the first experiment, dot clusters presented with a sound delay were judged to be more distant than dot clusters paired with equivalent sound leads. In the second experiment, we confirmed that the presence of a sound delay was sufficient to cause stimuli to appear as more distant. Additionally, we found that ecologically congruent pairing of more distant events with a sound delay resulted in an increase in the precision of distance judgments. A control experiment determined that the sound delay duration influencing these distance judgments was not detectable, thereby eliminating decision-level influence. In sum, we present evidence that audiovisual delays can be an ordinal cue to visual distance.     

Opponent and nonopponent contributions to the zebrafish electroretinogram using heterochromatic flicker photometry

While some lower vertebrates, such as zebrafish, do not appear to possess anatomically separate pathways of processing visual information (such as M-pathways and P-pathways), it is believed that separate processing of the visual stimulus (such as luminance and chromatic processing) is a basic requirement of vertebrate vision. In this study, spectral sensitivity functions were obtained from electroretinogram responses to heterochromatic flicker photometry stimuli at several flicker rates, including a low flicker rate (2 Hz), in an attempt to predominantly stimulate chromatic processes and a high flicker rate (16 Hz), in an attempt to predominantly stimulate luminance processes. In addition, chromatic adaptation was used to isolate and examine the temporal properties of the different cone-type contributions to the electroretinogram response. Spectral sensitivity functions based on responses to heterochromatic stimuli of a low flicker rate appeared to receive both opponent and nonopponent contributions; however, when the stimulus flicker rate was high, spectral sensitivity appeared to be a function of only nonopponent mechanisms. Also, the differences in cone contributions to the spectral sensitivity functions across the different flicker rates appear to be related to the temporal properties of the cone contributions to the electroretinogram response.