What we see is how we are: new paradigms in visual research

As most sensory modalities, the visual system needs to deal with very fast changes in the environment. Instead of processing all sensory stimuli, the brain is able to construct a perceptual experience by combining selected sensory input with an ongoing internal activity. Thus, the study of visual perception needs to be approached by examining not only the physical properties of stimuli, but also the brain's ongoing dynamical states onto which these perturbations are imposed. At least three different models account for this internal dynamics. One model is based on cardinal cells where the activity of few cells by itself constitutes the neuronal correlate of perception, while a second model is based on a population coding that states that the neuronal correlate of perception requires distributed activity throughout many areas of the brain. A third proposition, known as the temporal correlation hypothesis states that the distributed neuronal populations that correlate with perception, are also defined by synchronization of the activity on a millisecond time scale. This would serve to encode contextual information by defining relations between the features of visual objects. If temporal properties of neural activity are important to establish the neural mechanisms of perception, then the study of appropriate dynamical stimuli should be instrumental to determine how these systems operate. The use of natural stimuli and natural behaviors such as free viewing, which features fast changes of internal brain states as seen by motor markers, is proposed as a new experimental paradigm to study visual perception.     

小鼠对不同拓扑性质图形的识别

视觉感知的一系列研究都支持大范围拓扑感知的理论．拓扑性质作为整体性质,是视觉感知的基础．视觉对图形拓扑特征差异的感知要优先于对局部特征差异的感知．采用Y迷宫研究了小鼠对不同拓扑性质图形的识别．训练小鼠学习识别圆环和实心矩形这一对拓扑性质不同的图形,之后用拓扑特征相同或不同的其他图形测试小鼠,这些图形包括空心矩形、实心圆、缺口的圆环、缺口的空心矩形．实验结果表明,学会识别圆环(奖励)和实心矩形(无奖励)的小鼠无法区分实心圆和实心矩形以及圆环和空心矩形,但是能够分别从缺口圆环、缺口的空心矩形、实心圆与空心矩形组成的图形对中识别出空心矩形．因此证实了小鼠的视觉系统能够感知拓扑特征的差异并且具有对拓扑性质的概括能力．结果为拓扑知觉对视觉系统来说是基本的这一假设提供了证据．     

The effect of learning on the function of monkey extrastriate visual cortex

One of the most remarkable capabilities of the adult brain is its ability to learn and continuously adapt to an ever-changing environment. While many studies have documented how learning improves the perception and identification of visual stimuli, relatively little is known about how it modifies the underlying neural mechanisms. We trained monkeys to identify natural images that were degraded by interpolation with visual noise. We found that learning led to an improvement in monkeys' ability to identify these indeterminate visual stimuli. We link this behavioral improvement to a learning-dependent increase in the amount of information communicated by V4 neurons. This increase was mediated by a specific enhancement in neural activity. Our results reveal a mechanism by which learning increases the amount of information that V4 neurons are able to extract from the visual environment. This suggests that V4 plays a key role in resolving indeterminate visual inputs by coordinated interaction between bottom-up and top-down processing streams.     

How do we select perceptions and actions? Human brain imaging studies.

The selective nature of human perception and action implies a modulatory interaction between sensorimotor processes and attentional processes. This paper explores the use of functional imaging in humans to explore the mechanisms of perceptual selection and the fate of irrelevant stimuli that are not selected. Experiments with positron emission tomography show that two qualitatively different patterns of modulation of cerebral blood flow can be observed in experiments where non-spatial visual attention and auditory attention are manipulated. These patterns of modulation of cerebral blood flow modulation can be described as gain control and bias signal mechanisms. In visual and auditory cortex, the dominant change in cerebral blood flow associated with attention to either modality is related to a bias signal. The relation of these patterns of modulation to attentional effects that have been observed in single neurons is discussed. The existence of mechanisms for selective perception raises the more general question of whether irrelevant ignored stimuli are nevertheless perceived. Lavie''s theory of attention proposes that the degree to which ignored stimuli are processed varies depending on the perceptual load of the current task. Evidence from behavioural and functional magnetic resonance imaging studies of ignored visual motion processing is presented in support of this proposal.     

To what extent are emotional visual stimuli processed without attention and awareness?

In the past few years, important contributions have been made to the study of emotional visual perception. Researchers have reported responses to emotional stimuli in the human amygdala under some unattended conditions (i.e. conditions in which the focus of attention was diverted away from the stimuli due to task instructions), during visual masking and during binocular suppression. Taken together, these results reveal the relative degree of autonomy of emotional processing. At the same time, however, important limitations to the notion of complete automaticity have been revealed. Effects of task context and attention have been shown, as well as large inter-subject differences in sensitivity to the detection of masked fearful faces (whereby briefly presented, target fearful faces are immediately followed by a neutral face that 'masks' the initial face). A better understanding of the neural basis of emotional perception and how it relates to visual attention and awareness is likely to require further refinement of the concepts of automaticity and awareness.     

Rhythmic TMS over parietal cortex links distinct brain frequencies to global versus local visual processing

Neural networks underlying visual perception exhibit oscillations at different frequencies (e.g.,). But how these map onto distinct aspects of visual perception remains elusive. Recent electroencephalography data indicate that theta or beta frequencies at parietal sensors increase in amplitude when conscious perception is dominated by global or local features, respectively, of a reversible visual stimulus. But this provides only correlative, noninterventional evidence. Here we show via transcranial magnetic stimulation (TMS) interventions that short rhythmic bursts of right-parietal TMS at theta or beta frequency can causally benefit processing of global or local levels, respectively, for hierarchical visual stimuli, especially in the context of salient incongruent distractors. This double dissociation between theta and beta TMS reveals distinct causal roles for particular frequencies in processing global versus local visual features.     

Opposite Distortions in Interval Timing Perception for Visual and Auditory Stimuli with Temporal Modulations

When an object is presented visually and moves or flickers, the perception of its duration tends to be overestimated. Such an overestimation is called time dilation. Perceived time can also be distorted when a stimulus is presented aurally as an auditory flutter, but the mechanisms and their relationship to visual processing remains unclear. In the present study, we measured interval timing perception while modulating the temporal characteristics of visual and auditory stimuli, and investigated whether the interval times of visually and aurally presented objects shared a common mechanism. In these experiments, participants compared the durations of flickering or fluttering stimuli to standard stimuli, which were presented continuously. Perceived durations for auditory flutters were underestimated, while perceived durations of visual flickers were overestimated. When auditory flutters and visual flickers were presented simultaneously, these distortion effects were cancelled out. When auditory flutters were presented with a constantly presented visual stimulus, the interval timing perception of the visual stimulus was affected by the auditory flutters. These results indicate that interval timing perception is governed by independent mechanisms for visual and auditory processing, and that there are some interactions between the two processing systems.     

Colour spaces in ecology and evolutionary biology

The recognition that animals sense the world in a different way than we do has unlocked important lines of research in ecology and evolutionary biology. In practice, the subjective study of natural stimuli has been permitted by perceptual spaces, which are graphical models of how stimuli are perceived by a given animal. Because colour vision is arguably the best‐known sensory modality in most animals, a diversity of colour spaces are now available to visual ecologists, ranging from generalist and basic models allowing rough but robust predictions on colour perception, to species‐specific, more complex models giving accurate but context‐dependent predictions. Selecting among these models is most often influenced by historical contingencies that have associated models to specific questions and organisms; however, these associations are not always optimal. The aim of this review is to provide visual ecologists with a critical perspective on how models of colour space are built, how well they perform and where their main limitations are with regard to their most frequent uses in ecology and evolutionary biology. We propose a classification of models based on their complexity, defined as whether and how they model the mechanisms of chromatic adaptation and receptor opponency, the nonlinear association between the stimulus and its perception, and whether or not models have been fitted to experimental data. Then, we review the effect of modelling these mechanisms on predictions of colour detection and discrimination, colour conspicuousness, colour diversity and diversification, and for comparing the perception of colour traits between distinct perceivers. While a few rules emerge (e.g. opponent log–linear models should be preferred when analysing very distinct colours), in general model parameters still have poorly known effects. Colour spaces have nonetheless permitted significant advances in ecology and evolutionary biology, and more progress is expected if ecologists compare results between models and perform behavioural experiments more routinely. Such an approach would further contribute to a better understanding of colour vision and its links to the behavioural ecology of animals. While visual ecology is essentially a transfer of knowledge from visual sciences to evolutionary ecology, we hope that the discipline will benefit both fields more evenly in the future.     

Attention driven phantom vision: measuring the sensory strength of attentional templates and their relation to visual mental imagery and aphantasia

When we search for an object in an array or anticipate attending to a future object, we create an ‘attentional template'' of the object. The definitions of attentional templates and visual imagery share many similarities as well as many of the same neural characteristics. However, the phenomenology of these attentional templates and their neural similarities to visual imagery and perception are rarely, if ever discussed. Here, we investigate the relationship between these two forms of non-retinal phantom vision through the use of the binocular rivalry technique, which allows us to measure the sensory strength of attentional templates in the absence of concurrent perceptual stimuli. We find that attentional templates correlate with both feature-based attention and visual imagery. Attentional templates, like imagery, were significantly disrupted by the presence of irrelevant visual stimuli, while feature-based attention was not. We also found that a special population who lack the ability to visualize (aphantasia), showed evidence of feature-based attention when measured using the binocular rivalry paradigm, but not attentional templates. Taken together, these data suggest functional similarities between attentional templates and visual imagery, advancing the theory of visual imagery as a general simulation tool used across cognition.This article is part of the theme issue ‘Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation’.     

连续闪现抑制下对洞的无意识知觉

大量收敛一致的实验证据表明,图形的大范围性质可以由拓扑性质来描述,并且其检测发生在视觉过程的最早期,这些证据几乎全部来自对意识上知觉的研究,而拓扑性质的意识下加工机制尚有待发掘.意识下知觉是人的感官系统客观上接受刺激呈现但主观上没有察觉的知觉,其机制和应用长期以来一直是知觉研究的热点.本文采用了一种双眼竞争的变式——连续闪现抑制,将待检测的刺激图形掩蔽,使之处于意识下状态,考察意识下知觉中拓扑性质的加工."洞的个数"作为一种拓扑性质是本文的研究对象.通过量度被抑制图形从发生变化到被知觉的被抑制时间,或者被试对被抑制的变化图形的正确检测率,我们发现,相比于不变或者各种非拓扑性质变化,意识下知觉中的拓扑性质(洞的个数)的变化会使图形更快、更容易被检测到.本研究揭示了拓扑性质(洞的个数)在意识下知觉中的优先性,将拓扑知觉理论从意识上知觉领域拓展到了意识下知觉领域,为拓扑性质加工的早期性提供了有力的证据;另一方面,本研究也提示了拓扑性质经由皮层下视通路加工处理的可能性.     

Bioelectric brain activity during visual perception of verbalized and nonverbalized stimuli in seven-to eight-year-old schoolchildren

Neurophysiological mechanisms of visual perception of verbalized and nonverbalized stimuli have been studied in girls (n = 89) and boys (n = 109) aged seven to eight years. It has been shown that, in children of this age, neurophysiological mechanisms of the visual perception system during the selection of verbalized and nonverbalized stimuli have similar organizations of functional rearrangements and are characterized by the general involvement of cortical areas and by the lack of clear specialization of the cerebral hemispheres. However, the choice of nonverbalized visual stimuli is characterized by a more pronounced generalization of the functional interaction between cortical areas and by the increased spectral power of the EEG’s high-frequency components in anterior associative areas. The increased spatial synchronization in the EEG θ- and β bands in the frontal areas emphasizes the contribution of these structures to the analysis and processing of visual stimuli at this stage of development. Differences in the neurophysiological mechanisms of visual perception in boys and girls have been detected. Spatial and temporal organizations of bioelectric activity (BEA) of the brain in girls performing visual tasks is characterized by a stronger and more varied ipsi- and contralateral statistical relationships in the fronto-occipital direction and displacement of interaction centers to the left hemisphere. In boys perceiving verbalized and nonverbalized visual stimuli, a greater contribution of posterocentral cortical areas has been observed. The detected differences are considered to reflect a greater maturity of identification mechanisms in girls aged seven to eight years as compared to boys.     

运动对时距知觉的影响及其神经机制

在运动过程中,时距知觉的能力非常重要,能帮助个体对时长进行判断及对事件的发生做出预测和准备.近年来,越来越多的研究发现运动本身会直接影响个体的时距知觉.本文分别从运动参数、运动阶段、视觉运动刺激和运动有关的个体因素四个方面梳理了运动对时距知觉产生影响的行为学证据.目前已经有大量研究从不同角度证明,大脑运动系统组成了支持...     

The role of the posterior parietal cortex in coordinate transformations for visual-motor integration

Lesion to the posterior parietal cortex in monkeys and humans produces spatial deficits in movement and perception. In recording experiments from area 7a, a cortical subdivision in the posterior parietal cortex in monkeys, we have found neurons whose responses are a function of both the retinal location of visual stimuli and the position of the eyes in the orbits. By combining these signals area 7 a neurons code the location of visual stimuli with respect to the head. However, these cells respond over only limited ranges of eye positions (eye-position-dependent coding). To code location in craniotopic space at all eye positions (eye-position-independent coding) an additional step in neural processing is required that uses information distributed across populations of area 7a neurons. We describe here a neural network model, based on back-propagation learning, that both demonstrates how spatial location could be derived from the population response of area 7a neurons and accurately accounts for the observed response properties of these neurons.     

Imagine Jane and identify John: face identity aftereffects induced by imagined faces

It is not known whether prolonged exposure to perceived and imagined complex visual images produces similar shifts in subsequent perception through selective adaptation. This question is important because a positive finding would suggest that perception and imagery of visual stimuli are mediated by shared neural networks. In this study, we used a selective adaptation procedure designed to induce high-level face-identity aftereffects--a phenomenon in which extended exposure to a particular face facilitates recognition of subsequent faces with opposite features while impairing recognition of all other faces. We report here that adaptation to either real or imagined faces produces a similar shift in perception and that identity boundaries represented in real and imagined faces are equivalent. Together, our results show that identity information contained in imagined and real faces produce similar behavioral outcomes. Our findings of high-level visual aftereffects induced by imagined stimuli can be taken as evidence for the involvement of shared neural networks that mediate perception and imagery of complex visual stimuli.     

Compelling classroom demonstrations that link visual system anatomy,physiology, and behaviour

One of our approaches to teaching a course in anatomy and physiology is to stress the fundamental, systems-level concepts. One successful strategy we use is to continually highlight the relationships among anatomy, physiology, and behavior. In this article, we describe a set of classroom demonstrations that stress these links while fostering critical thinking. These demonstrations, on the topic of sensory system structure and function, rely on two perceptual consequences of neural adaptation in the visual system: afterimages and aftereffects. Viewing specific visual stimuli under binocular or monocular conditions with interocular transfer permits several concepts to be observed and discussed, including neural adaptation, anatomical and functional segregation of visual system pathways, and the relationship among visual system structure, function, and perception. This article discusses how to produce and present the required visual stimuli, suggests a set of questions to stimulate critical thinking, and presents student evaluation of this activity.     

Depth Perception Not Found in Human Observers for Static or Dynamic Anti-Correlated Random Dot Stereograms

One of the greatest challenges in visual neuroscience is that of linking neural activity with perceptual experience. In the case of binocular depth perception, important insights have been achieved through comparing neural responses and the perception of depth, for carefully selected stimuli. One of the most important types of stimulus that has been used here is the anti-correlated random dot stereogram (ACRDS). In these stimuli, the contrast polarity of one half of a stereoscopic image is reversed. While neurons in cortical area V1 respond reliably to the binocular disparities in ACRDS, they do not create a sensation of depth. This discrepancy has been used to argue that depth perception must rely on neural activity elsewhere in the brain. Currently, the psychophysical results on which this argument rests are not clear-cut. While it is generally assumed that ACRDS do not support the perception of depth, some studies have reported that some people, some of the time, perceive depth in some types of these stimuli. Given the importance of these results for understanding the neural correlates of stereopsis, we studied depth perception in ACRDS using a large number of observers, in order to provide an unambiguous conclusion about the extent to which these stimuli support the perception of depth. We presented observers with random dot stereograms in which correlated dots were presented in a surrounding annulus and correlated or anti-correlated dots were presented in a central circular region. While observers could reliably report the depth of the central region for correlated stimuli, we found no evidence for depth perception in static or dynamic anti-correlated stimuli. Confidence ratings for stereoscopic perception were uniformly low for anti-correlated stimuli, but showed normal variation with disparity for correlated stimuli. These results establish that the inability of observers to perceive depth in ACRDS is a robust phenomenon.     

The scope and limits of top-down attention in unconscious visual processing

Attentional selection plays a critical role in conscious perception. When attention is diverted, even salient stimuli fail to reach visual awareness. Attention can be voluntarily directed to a spatial location or a visual feature for facilitating the processing of information relevant to current goals. In everyday situations, attention and awareness are tightly coupled. This has led some to suggest that attention and awareness might be based on a common neural foundation, whereas others argue that they are mediated by distinct mechanisms. A body of evidence shows that visual stimuli can be processed at multiple stages of the visual-processing streams without evoking visual awareness. To illuminate the relationship between visual attention and conscious perception, we investigated whether top-down attention can target and modulate the neural representations of unconsciously processed visual stimuli. Our experiments show that spatial attention can target only consciously perceived stimuli, whereas feature-based attention can modulate the processing of invisible stimuli. The attentional modulation of unconscious signals implies that attention and awareness can be dissociated, challenging a simplistic view of the boundary between conscious and unconscious visual processing.     

Host-plant selection by insects – a theory based on `appropriate/inappropriate landings'' by pest insects of cruciferous plants

Seven hypotheses, including the `Resource Concentration Hypothesis' and the `Enemies Hypothesis', have been put forward to explain why fewer specialist insects are found on host plants growing in diverse backgrounds than on similar plants growing in bare soil. All seven hypotheses are discussed and discounted, primarily because no one has used any of them to produce a general theory of host plant selection, they still remain as hypotheses. However, we have developed a general theory based on detailed observations of insect behaviour. Our theory is based on the fact that during host plant finding the searching insects land indiscriminately on green objects such as the leaves of host plants (appropriate landings) and non-host plants (inappropriate landings), but avoid landing on brown surfaces, such as soil. The complete system of host plant selection involves a three-link chain of events in which the first link is governed by cues from volatile plant chemicals, the central link by visual stimuli, and the final link by cues from non-volatile plant chemicals. The previously `missing' central link, which is based on what we have described as `appropriate/inappropriate landings', is governed by visual stimuli. Our theory explains why attempts to show that olfaction is the crucial component in the central link of host plant selection proved intractable. The `appropriate/inappropriate landings' theory is discussed to indicate the type of work needed in future studies to improve our understanding of how intercropping, undersowing and companion planting can be used to optimum effect in crop protection. The new theory is used also to suggest how insect biotypes could develop and to describe why pest insects do not decimate wild host plants growing in `natural' situations.     

Naturalistic Stimulus Structure Determines the Integration of Audiovisual Looming Signals in Binocular Rivalry

Rapid integration of biologically relevant information is crucial for the survival of an organism. Most prominently, humans should be biased to attend and respond to looming stimuli that signal approaching danger (e.g. predator) and hence require rapid action. This psychophysics study used binocular rivalry to investigate the perceptual advantage of looming (relative to receding) visual signals (i.e. looming bias) and how this bias can be influenced by concurrent auditory looming/receding stimuli and the statistical structure of the auditory and visual signals.Subjects were dichoptically presented with looming/receding visual stimuli that were paired with looming or receding sounds. The visual signals conformed to two different statistical structures: (1) a ‘simple’ random-dot kinematogram showing a starfield and (2) a “naturalistic” visual Shepard stimulus. Likewise, the looming/receding sound was (1) a simple amplitude- and frequency-modulated (AM-FM) tone or (2) a complex Shepard tone. Our results show that the perceptual looming bias (i.e. the increase in dominance times for looming versus receding percepts) is amplified by looming sounds, yet reduced and even converted into a receding bias by receding sounds. Moreover, the influence of looming/receding sounds on the visual looming bias depends on the statistical structure of both the visual and auditory signals. It is enhanced when audiovisual signals are Shepard stimuli.In conclusion, visual perception prioritizes processing of biologically significant looming stimuli especially when paired with looming auditory signals. Critically, these audiovisual interactions are amplified for statistically complex signals that are more naturalistic and known to engage neural processing at multiple levels of the cortical hierarchy.