Cross-modal distortion of time perception: demerging the effects of observed and performed motion

Temporal information is often contained in multi-sensory stimuli, but it is currently unknown how the brain combines e.g. visual and auditory cues into a coherent percept of time. The existing studies of cross-modal time perception mainly support the "modality appropriateness hypothesis", i.e. the domination of auditory temporal cues over visual ones because of the higher precision of audition for time perception. However, these studies suffer from methodical problems and conflicting results. We introduce a novel experimental paradigm to examine cross-modal time perception by combining an auditory time perception task with a visually guided motor task, requiring participants to follow an elliptic movement on a screen with a robotic manipulandum. We find that subjective duration is distorted according to the speed of visually observed movement: The faster the visual motion, the longer the perceived duration. In contrast, the actual execution of the arm movement does not contribute to this effect, but impairs discrimination performance by dual-task interference. We also show that additional training of the motor task attenuates the interference, but does not affect the distortion of subjective duration. The study demonstrates direct influence of visual motion on auditory temporal representations, which is independent of attentional modulation. At the same time, it provides causal support for the notion that time perception and continuous motor timing rely on separate mechanisms, a proposal that was formerly supported by correlational evidence only. The results constitute a counterexample to the modality appropriateness hypothesis and are best explained by Bayesian integration of modality-specific temporal information into a centralized "temporal hub".     

运动对时距知觉的影响及其神经机制

在运动过程中,时距知觉的能力非常重要,能帮助个体对时长进行判断及对事件的发生做出预测和准备.近年来,越来越多的研究发现运动本身会直接影响个体的时距知觉.本文分别从运动参数、运动阶段、视觉运动刺激和运动有关的个体因素四个方面梳理了运动对时距知觉产生影响的行为学证据.目前已经有大量研究从不同角度证明,大脑运动系统组成了支持...     

Spatially localized distortions of event time

A fundamental question about the perception of time is whether the neural mechanisms underlying temporal judgements are universal and centralized in the brain or modality specific and distributed. Time perception has traditionally been thought to be entirely dissociated from spatial vision. Here we show that the apparent duration of a dynamic stimulus can be manipulated in a local region of visual space by adapting to oscillatory motion or flicker. This implicates spatially localized temporal mechanisms in duration perception. We do not see concomitant changes in the time of onset or offset of the test patterns, demonstrating a direct local effect on duration perception rather than an indirect effect on the time course of neural processing. The effects of adaptation on duration perception can also be dissociated from motion or flicker perception per se. Although 20 Hz adaptation reduces both the apparent temporal frequency and duration of a 10 Hz test stimulus, 5 Hz adaptation increases apparent temporal frequency but has little effect on duration perception. We conclude that there is a peripheral, spatially localized, essentially visual component involved in sensing the duration of visual events.     

Ready steady slow: action preparation slows the subjective passage of time

Professional ball game players report the feeling of the ball ‘slowing-down’ before hitting it. Because effective motor preparation is critical in achieving such expert motor performance, these anecdotal comments imply that the subjective passage of time may be influenced by preparation for action. Previous reports of temporal illusions associated with action generally emphasize compensation for suppressed sensory signals that accompany motor commands. Here, we show that the time is perceived slowed-down during preparation of a ballistic reaching movement before action, involving enhancement of sensory processing. Preparing for a reaching movement increased perceived duration of a visual stimulus. This effect was tightly linked to action preparation, because the amount of temporal dilation increased with the information about the upcoming movement. Furthermore, we showed a reduction of perceived frequency for flickering stimuli and an enhanced detection of rapidly presented letters during action preparation, suggesting increased temporal resolution of visual perception during action preparation. We propose that the temporal dilation during action preparation reflects the function of the brain to maximize the capacity of sensory information-acquisition prior to execution of a ballistic movement. This strategy might facilitate changing or inhibiting the planned action in response to last-minute changes in the external environment.     

Duration channels mediate human time perception

The task of deciding how long sensory events seem to last is one that the human nervous system appears to perform rapidly and, for sub-second intervals, seemingly without conscious effort. That these estimates can be performed within and between multiple sensory and motor domains suggest time perception forms one of the core, fundamental processes of our perception of the world around us. Given this significance, the current paucity in our understanding of how this process operates is surprising. One candidate mechanism for duration perception posits that duration may be mediated via a system of duration-selective 'channels', which are differentially activated depending on the match between afferent duration information and the channels' 'preferred' duration. However, this model awaits experimental validation. In the current study, we use the technique of sensory adaptation, and we present data that are well described by banks of duration channels that are limited in their bandwidth, sensory-specific, and appear to operate at a relatively early stage of visual and auditory sensory processing. Our results suggest that many of the computational principles the nervous system applies to coding visual spatial and auditory spectral information are common to its processing of temporal extent.     

Human time perception and its illusions

Why does a clock sometimes appear stopped? Is it possible to perceive the world in slow motion during a car accident? Can action and effect be reversed? Time perception is surprisingly prone to measurable distortions and illusions. The past few years have introduced remarkable progress in identifying and quantifying temporal illusions of duration, temporal order, and simultaneity. For example, perceived durations can be distorted by saccades, by an oddball in a sequence, or by stimulus complexity or magnitude. Temporal order judgments of actions and sensations can be reversed by the exposure to delayed motor consequences, and simultaneity judgments can be manipulated by repeated exposure to nonsimultaneous stimuli. The confederacy of recently discovered illusions points to the underlying neural mechanisms of time perception.     

Visual Benefits in Apparent Motion Displays: Automatically Driven Spatial and Temporal Anticipation Are Partially Dissociated

Many behaviourally relevant sensory events such as motion stimuli and speech have an intrinsic spatio-temporal structure. This will engage intentional and most likely unintentional (automatic) prediction mechanisms enhancing the perception of upcoming stimuli in the event stream. Here we sought to probe the anticipatory processes that are automatically driven by rhythmic input streams in terms of their spatial and temporal components. To this end, we employed an apparent visual motion paradigm testing the effects of pre-target motion on lateralized visual target discrimination. The motion stimuli either moved towards or away from peripheral target positions (valid vs. invalid spatial motion cueing) at a rhythmic or arrhythmic pace (valid vs. invalid temporal motion cueing). Crucially, we emphasized automatic motion-induced anticipatory processes by rendering the motion stimuli non-predictive of upcoming target position (by design) and task-irrelevant (by instruction), and by creating instead endogenous (orthogonal) expectations using symbolic cueing. Our data revealed that the apparent motion cues automatically engaged both spatial and temporal anticipatory processes, but that these processes were dissociated. We further found evidence for lateralisation of anticipatory temporal but not spatial processes. This indicates that distinct mechanisms may drive automatic spatial and temporal extrapolation of upcoming events from rhythmic event streams. This contrasts with previous findings that instead suggest an interaction between spatial and temporal attention processes when endogenously driven. Our results further highlight the need for isolating intentional from unintentional processes for better understanding the various anticipatory mechanisms engaged in processing behaviourally relevant stimuli with predictable spatio-temporal structure such as motion and speech.     

Timing Rhythms: Perceived Duration Increases with a Predictable Temporal Structure of Short Interval Fillers

Variations in the temporal structure of an interval can lead to remarkable differences in perceived duration. For example, it has previously been shown that isochronous intervals, that is, intervals filled with temporally regular stimuli, are perceived to last longer than intervals left empty or filled with randomly timed stimuli. Characterizing the extent of such distortions is crucial to understanding how duration perception works. One account to explain effects of temporal structure is a non-linear accumulator-counter mechanism reset at the beginning of every subinterval. An alternative explanation based on entrainment to regular stimulation posits that the neural response to each filler stimulus in an isochronous sequence is amplified and a higher neural response may lead to an overestimation of duration. If entrainment is the key that generates response amplification and the distortions in perceived duration, then any form of predictability in the temporal structure of interval fillers should lead to the perception of an interval that lasts longer than a randomly filled one. The present experiments confirm that intervals filled with fully predictable rhythmically grouped stimuli lead to longer perceived duration than anisochronous intervals. No general over- or underestimation is registered for rhythmically grouped compared to isochronous intervals. However, we find that the number of stimuli in each group composing the rhythm also influences perceived duration. Implications of these findings for a non-linear clock model as well as a neural response magnitude account of perceived duration are discussed.     

The hierarchy of directional interactions in visual motion processing

It is well known that context influences our perception of visual motion direction. For example, spatial and temporal context manipulations can be used to induce two well-known motion illusions: direction repulsion and the direction after-effect (DAE). Both result in inaccurate perception of direction when a moving pattern is either superimposed on (direction repulsion), or presented following adaptation to (DAE), another pattern moving in a different direction. Remarkable similarities in tuning characteristics suggest that common processes underlie the two illusions. What is not clear, however, is whether the processes driving the two illusions are expressions of the same or different neural substrates. Here we report two experiments demonstrating that direction repulsion and the DAE are, in fact, expressions of different neural substrates. Our strategy was to use each of the illusions to create a distorted perceptual representation upon which the mechanisms generating the other illusion could potentially operate. We found that the processes mediating direction repulsion did indeed access the distorted perceptual representation induced by the DAE. Conversely, the DAE was unaffected by direction repulsion. Thus parallels in perceptual phenomenology do not necessarily imply common neural substrates. Our results also demonstrate that the neural processes driving the DAE occur at an earlier stage of motion processing than those underlying direction repulsion.     

Asynchrony adaptation reveals neural population code for audio-visual timing

The relative timing of auditory and visual stimuli is a critical cue for determining whether sensory signals relate to a common source and for making inferences about causality. However, the way in which the brain represents temporal relationships remains poorly understood. Recent studies indicate that our perception of multisensory timing is flexible--adaptation to a regular inter-modal delay alters the point at which subsequent stimuli are judged to be simultaneous. Here, we measure the effect of audio-visual asynchrony adaptation on the perception of a wide range of sub-second temporal relationships. We find distinctive patterns of induced biases that are inconsistent with the previous explanations based on changes in perceptual latency. Instead, our results can be well accounted for by a neural population coding model in which: (i) relative audio-visual timing is represented by the distributed activity across a relatively small number of neurons tuned to different delays; (ii) the algorithm for reading out this population code is efficient, but subject to biases owing to under-sampling; and (iii) the effect of adaptation is to modify neuronal response gain. These results suggest that multisensory timing information is represented by a dedicated population code and that shifts in perceived simultaneity following asynchrony adaptation arise from analogous neural processes to well-known perceptual after-effects.     

Self versus Environment Motion in Postural Control

To stabilize our position in space we use visual information as well as non-visual physical motion cues. However, visual cues can be ambiguous: visually perceived motion may be caused by self-movement, movement of the environment, or both. The nervous system must combine the ambiguous visual cues with noisy physical motion cues to resolve this ambiguity and control our body posture. Here we have developed a Bayesian model that formalizes how the nervous system could solve this problem. In this model, the nervous system combines the sensory cues to estimate the movement of the body. We analytically demonstrate that, as long as visual stimulation is fast in comparison to the uncertainty in our perception of body movement, the optimal strategy is to weight visually perceived movement velocities proportional to a power law. We find that this model accounts for the nonlinear influence of experimentally induced visual motion on human postural behavior both in our data and in previously published results.     

高寒生态脆弱区农户对气候变化的感知与适应意向——以甘南高原为例

以地处青藏高原东缘的甘南高原为研究区,基于农户调查数据,分析了农户的气候变化感知对其适应意向的影响,为制定有效的气候变化适应政策提供依据.结果表明: 纯农户、兼业户、非农户对气候变化的严重性的感知依次降低,但适应功效感知依次增强,且与非农户、纯农户相比,兼业户的可能性感知、自我效能感知与适应成本感知均较高;纯农户、兼业户、非农户对气候变化的积极适应意向趋于增强;气候变化风险感知、适应功效感知促使农户产生积极适应意向,而适应成本感知促使其产生消极适应意向.同时,农户拥有的耕地面积、牲畜数量、收入水平以及性格乐观程度与积极适应意向发生概率呈显著正相关,而固定资产拥有量、无偿现金援助机会、亲戚网及帮助网规模与其呈显著负相关.最后,提出了促使农户产生积极适应意向的对策建议及未来研究中需关注的问题.     

The dynamics of velocity adaptation in human vision

Since Barlow and Hill's classic study of the adaptation of the rabbit ganglion cell to movement [1], there have been several reports that motion adaptation is accompanied by an exponential reduction in spike rate, and similar estimates of the time course of velocity adaptation have been found across species [2-4]. Psychophysical studies in humans have shown that perceived velocity may reduce exponentially with adaptation [5,6]. It has been suggested that the reduction in firing of single cells may constitute the neural substrate of the reduction in perceived speed in humans [1,5-7]. Although a model of velocity coding in which the firing rate directly encodes speed may have the advantage of simplicity, it is not supported by psychophysical research. Furthermore, psychophysical estimates of the time course of perceived speed adaptation are not entirely consistent with physiological estimates. This discrepancy between psychophysical and physiological estimates may be due to the unrealistic assumption that speed is coded in the gross spike rate of neurons in the primary visual cortex. The psychophysical data on motion processing are, however, generally consistent with a model in which perceived velocity is derived from the ratio of two temporal channels [8-14]. We have examined the time course of speed adaptation and recovery to determine whether the observed rates can be better related to the established physiology if a ratio model of velocity processing is assumed. Our results indicate that such a model describes the data well and can accommodate the observed difference in the time courses of physiological and psychophysical processes.     

Directional anisotropies reveal a functional segregation of visual motion processing for perception and action

Human exhibits an anisotropy in direction perception: discrimination is superior when motion is around horizontal or vertical rather than diagonal axes. In contrast to the consistent directional anisotropy in perception, we found only small idiosyncratic anisotropies in smooth pursuit eye movements, a motor action requiring accurate discrimination of visual motion direction. Both pursuit and perceptual direction discrimination rely on signals from the middle temporal visual area (MT), yet analysis of multiple measures of MT neuronal responses in the macaque failed to provide evidence of a directional anisotropy. We conclude that MT represents different motion directions uniformly, and subsequent processing creates a directional anisotropy in pathways unique to perception. Our data support the hypothesis that, at least for visual motion, perception and action are guided by inputs from separate sensory streams. The directional anisotropy of perception appears to originate after the two streams have segregated and downstream from area MT.     

Cortical processing and perceived timing

As of yet, it is unclear how we determine relative perceived timing. One controversial suggestion is that timing perception might be related to when analyses are completed in the cortex of the brain. An alternate proposal suggests that perceived timing is instead related to the point in time at which cortical analyses commence. Accordingly, timing illusions should not occur owing to cortical analyses, but they could occur if there were differential delays between signals reaching cortex. Resolution of this controversy therefore requires that the contributions of cortical processing be isolated from the influence of subcortical activity. Here, we have done this by using binocular disparity changes, which are known to be detected via analyses that originate in cortex. We find that observers require longer stimulus exposures to detect small, relative to larger, disparity changes; observers are slower to react to smaller disparity changes and observers misperceive smaller disparity changes as being perceptually delayed. Interestingly, disparity magnitude influenced perceived timing more dramatically than it did stimulus change detection. Our data therefore suggest that perceived timing is both influenced by cortical processing and is shaped by sensory analyses subsequent to those that are minimally necessary for stimulus change perception.     

高寒生态脆弱区农户对气候变化的感知——以甘南高原为例

气候变化作为人类当前面临的最严峻挑战,已对生态脆弱区农户生计产生严重的负面影响,明确农户对气候变化的感知对于制定有效的气候变化适应政策非常关键。以甘南高原为研究区,基于入户调查数据,构建了农户对气候变化的感知度指数,分析了甘南高原农户的气候变化感知特征,并采用经济计量模型分析了影响农户气候变化感知的关键因素。结果表明:(1)甘南高原农户对气温变化的感知能力强于对降水变化的感知,并对近期发生的、规模较大、影响较严重的极端天气记忆较深;(2)农户对气候变化的严重性及可能性感知较强烈,感知到的适应成本与适应功效也较高,但感知到的自我效能较弱,其气候变化严重性、可能性、适应功效、自我效能及适应成本感知度指数分别为3.76、3.34、3.43、2.85、3.53,且农区农户对气候变化的风险感知与适应感知均最强,半农半牧区次之,纯牧区最弱;(3)气候变化信息、农户的客观适应能力、农户对社会话语的信任度、适应激励均会影响农户的气候变化感知,其中,适应激励为最关键的影响因素,其与农户的气候变化适应功效感知、自我效能感知均呈正相关,而与风险感知、适应成本感知呈负相关。最后,针对如何提高农户气候变化感知的准确度,增强农户应对气候变化的能力,提出相关的政策建议。     

Distortions of subjective time perception within and across senses

Background

The ability to estimate the passage of time is of fundamental importance for perceptual and cognitive processes. One experience of time is the perception of duration, which is not isomorphic to physical duration and can be distorted by a number of factors. Yet, the critical features generating these perceptual shifts in subjective duration are not understood.

Methodology/Findings

We used prospective duration judgments within and across sensory modalities to examine the effect of stimulus predictability and feature change on the perception of duration. First, we found robust distortions of perceived duration in auditory, visual and auditory-visual presentations despite the predictability of the feature changes in the stimuli. For example, a looming disc embedded in a series of steady discs led to time dilation, whereas a steady disc embedded in a series of looming discs led to time compression. Second, we addressed whether visual (auditory) inputs could alter the perception of duration of auditory (visual) inputs. When participants were presented with incongruent audio-visual stimuli, the perceived duration of auditory events could be shortened or lengthened by the presence of conflicting visual information; however, the perceived duration of visual events was seldom distorted by the presence of auditory information and was never perceived shorter than their actual durations.

Conclusions/Significance

These results support the existence of multisensory interactions in the perception of duration and, importantly, suggest that vision can modify auditory temporal perception in a pure timing task. Insofar as distortions in subjective duration can neither be accounted for by the unpredictability of an auditory, visual or auditory-visual event, we propose that it is the intrinsic features of the stimulus that critically affect subjective time distortions.     

The Effect of Visual Apparent Motion on Audiovisual Simultaneity

Visual motion information from dynamic environments is important in multisensory temporal perception. However, it is unclear how visual motion information influences the integration of multisensory temporal perceptions. We investigated whether visual apparent motion affects audiovisual temporal perception. Visual apparent motion is a phenomenon in which two flashes presented in sequence in different positions are perceived as continuous motion. Across three experiments, participants performed temporal order judgment (TOJ) tasks. Experiment 1 was a TOJ task conducted in order to assess audiovisual simultaneity during perception of apparent motion. The results showed that the point of subjective simultaneity (PSS) was shifted toward a sound-lead stimulus, and the just noticeable difference (JND) was reduced compared with a normal TOJ task with a single flash. This indicates that visual apparent motion affects audiovisual simultaneity and improves temporal discrimination in audiovisual processing. Experiment 2 was a TOJ task conducted in order to remove the influence of the amount of flash stimulation from Experiment 1. The PSS and JND during perception of apparent motion were almost identical to those in Experiment 1, but differed from those for successive perception when long temporal intervals were included between two flashes without motion. This showed that the result obtained under the apparent motion condition was unaffected by the amount of flash stimulation. Because apparent motion was produced by a constant interval between two flashes, the results may be accounted for by specific prediction. In Experiment 3, we eliminated the influence of prediction by randomizing the intervals between the two flashes. However, the PSS and JND did not differ from those in Experiment 1. It became clear that the results obtained for the perception of visual apparent motion were not attributable to prediction. Our findings suggest that visual apparent motion changes temporal simultaneity perception and improves temporal discrimination in audiovisual processing.     

How Long Depends on How Fast—Perceived Flicker Dilates Subjective Duration

How do humans perceive the passage of time and the duration of events without a dedicated sensory system for timing? Previous studies have demonstrated that when a stimulus changes over time, its duration is subjectively dilated, indicating that duration judgments are based on the number of changes within an interval. In this study, we tested predictions derived from three different accounts describing the relation between a changing stimulus and its subjective duration as either based on (1) the objective rate of changes of the stimulus, (2) the perceived saliency of the changes, or (3) the neural energy expended in processing the stimulus. We used visual stimuli flickering at different frequencies (4–166 Hz) to study how the number of changes affects subjective duration. To this end, we assessed the subjective duration of these stimuli and measured participants'' behavioral flicker fusion threshold (the highest frequency perceived as flicker), as well as their threshold for a frequency-specific neural response to the flicker using EEG. We found that only consciously perceived flicker dilated perceived duration, such that a 2 s long stimulus flickering at 4 Hz was perceived as lasting as long as a 2.7 s steady stimulus. This effect was most pronounced at the slowest flicker frequencies, at which participants reported the most consistent flicker perception. Flicker frequencies higher than the flicker fusion threshold did not affect perceived duration at all, even if they evoked a significant frequency-specific neural response. In sum, our findings indicate that time perception in the peri-second range is driven by the subjective saliency of the stimulus'' temporal features rather than the objective rate of stimulus changes or the neural response to the changes.     

Mirroring Pain in the Brain: Emotional Expression versus Motor Imitation

Perception of pain in others via facial expressions has been shown to involve brain areas responsive to self-pain, biological motion, as well as both performed and observed motor actions. Here, we investigated the involvement of these different regions during emotional and motor mirroring of pain expressions using a two-task paradigm, and including both observation and execution of the expressions. BOLD responses were measured as subjects watched video clips showing different intensities of pain expression and, after a variable delay, either expressed the amount of pain they perceived in the clips (pain task), or imitated the facial movements (movement task). In the pain task condition, pain coding involved overlapping activation across observation and execution in the anterior cingulate cortex, supplementary motor area, inferior frontal gyrus/anterior insula, and the inferior parietal lobule, and a pain-related increase (pain vs. neutral) in the anterior cingulate cortex/supplementary motor area, the right inferior frontal gyrus, and the postcentral gyrus. The ‘mirroring’ response was stronger in the inferior frontal gyrus and middle temporal gyrus/superior temporal sulcus during the pain task, and stronger in the inferior parietal lobule in the movement task. These results strongly suggest that while motor mirroring may contribute to the perception of pain expressions in others, interpreting these expressions in terms of pain content draws more heavily on networks involved in the perception of affective meaning.